-- Logs begin at Fri 2022-07-01 02:34:39 UTC, end at Fri 2022-07-01 04:27:29 UTC. -- Jul 01 03:55:05.095931 dv-cinder-846842-8-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jul 01 03:55:05.109400 dv-cinder-846842-8-iscsi devstack@n-api.service[103970]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 01 03:55:05.111784 dv-cinder-846842-8-iscsi devstack@n-api.service[103970]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Jul 1 03:55:05 2022] *** Jul 01 03:55:05.111784 dv-cinder-846842-8-iscsi devstack@n-api.service[103970]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 01 03:55:05.111784 dv-cinder-846842-8-iscsi devstack@n-api.service[103970]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 01 03:55:05.111784 dv-cinder-846842-8-iscsi devstack@n-api.service[103970]: nodename: dv-cinder-846842-8-iscsi Jul 01 03:55:05.111784 dv-cinder-846842-8-iscsi devstack@n-api.service[103970]: machine: x86_64 Jul 01 03:55:05.111784 dv-cinder-846842-8-iscsi devstack@n-api.service[103970]: clock source: unix Jul 01 03:55:05.111784 dv-cinder-846842-8-iscsi devstack@n-api.service[103970]: pcre jit disabled Jul 01 03:55:05.111784 dv-cinder-846842-8-iscsi devstack@n-api.service[103970]: detected number of CPU cores: 4 Jul 01 03:55:05.111784 dv-cinder-846842-8-iscsi devstack@n-api.service[103970]: current working directory: / Jul 01 03:55:05.111784 dv-cinder-846842-8-iscsi devstack@n-api.service[103970]: detected binary path: /usr/bin/uwsgi-core Jul 01 03:55:05.112718 dv-cinder-846842-8-iscsi devstack@n-api.service[103970]: your processes number limit is 47680 Jul 01 03:55:05.112718 dv-cinder-846842-8-iscsi devstack@n-api.service[103970]: your memory page size is 4096 bytes Jul 01 03:55:05.112718 dv-cinder-846842-8-iscsi devstack@n-api.service[103970]: detected max file descriptor number: 2048 Jul 01 03:55:05.112718 dv-cinder-846842-8-iscsi devstack@n-api.service[103970]: lock engine: pthread robust mutexes Jul 01 03:55:05.112718 dv-cinder-846842-8-iscsi devstack@n-api.service[103970]: thunder lock: enabled Jul 01 03:55:05.112718 dv-cinder-846842-8-iscsi devstack@n-api.service[103970]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 01 03:55:05.112718 dv-cinder-846842-8-iscsi devstack@n-api.service[103970]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jul 01 03:55:05.158390 dv-cinder-846842-8-iscsi devstack@n-api.service[103970]: Python main interpreter initialized at 0x55aa86d1f9c0 Jul 01 03:55:05.158390 dv-cinder-846842-8-iscsi devstack@n-api.service[103970]: python threads support enabled Jul 01 03:55:05.158390 dv-cinder-846842-8-iscsi devstack@n-api.service[103970]: your server socket listen backlog is limited to 100 connections Jul 01 03:55:05.158390 dv-cinder-846842-8-iscsi devstack@n-api.service[103970]: your mercy for graceful operations on workers is 90 seconds Jul 01 03:55:05.158792 dv-cinder-846842-8-iscsi devstack@n-api.service[103970]: mapped 403077 bytes (393 KB) for 2 cores Jul 01 03:55:05.158858 dv-cinder-846842-8-iscsi devstack@n-api.service[103970]: *** Operational MODE: preforking *** Jul 01 03:55:05.159125 dv-cinder-846842-8-iscsi devstack@n-api.service[103970]: *** uWSGI is running in multiple interpreter mode *** Jul 01 03:55:05.159125 dv-cinder-846842-8-iscsi devstack@n-api.service[103970]: spawned uWSGI master process (pid: 103970) Jul 01 03:55:05.159356 dv-cinder-846842-8-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jul 01 03:55:05.160745 dv-cinder-846842-8-iscsi devstack@n-api.service[103970]: spawned uWSGI worker 1 (pid: 104009, cores: 1) Jul 01 03:55:05.160745 dv-cinder-846842-8-iscsi devstack@n-api.service[103970]: spawned uWSGI worker 2 (pid: 104010, cores: 1) Jul 01 03:55:05.162955 dv-cinder-846842-8-iscsi devstack@n-api.service[103970]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 01 03:55:05.830686 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 01 03:55:05.844305 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 01 03:55:06.960622 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 01 03:55:06.960622 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: from cryptography.utils import int_from_bytes Jul 01 03:55:06.961211 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 01 03:55:06.961211 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: from cryptography.utils import int_from_bytes Jul 01 03:55:06.962024 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 01 03:55:06.962024 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: from cryptography.utils import int_from_bytes Jul 01 03:55:06.962444 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 01 03:55:06.962444 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: from cryptography.utils import int_from_bytes Jul 01 03:55:09.433128 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 01 03:55:09.433706 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 01 03:55:09.434140 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 01 03:55:09.434509 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 01 03:55:09.434595 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 01 03:55:09.434676 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 01 03:55:09.434764 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 01 03:55:09.434933 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 01 03:55:09.435120 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:55:09.435336 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 01 03:55:09.435474 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:55:09.435604 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 01 03:55:09.435793 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:55:09.435995 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:55:09.436109 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:55:09.436322 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:55:09.436437 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:55:09.436646 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:55:09.436746 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:55:09.436966 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:55:09.437055 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:55:09.437300 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:55:09.437388 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:55:09.437613 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:55:09.437708 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:55:09.437903 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:55:09.437994 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:55:09.438216 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:55:09.438315 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:55:09.438536 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-846842-8-iscsi {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:55:09.438623 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:55:09.438806 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:55:09.438915 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:55:09.439125 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:55:09.439272 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:55:09.439464 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:55:09.439558 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-846842-8-iscsi {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:55:09.439786 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:55:09.439872 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:55:09.440089 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:55:09.440196 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:55:09.440399 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:55:09.440486 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:55:09.440698 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:55:09.440784 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:55:09.441067 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:55:09.441220 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:55:09.441530 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:55:09.441678 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:55:09.441947 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:55:09.442062 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:55:09.442255 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:55:09.442589 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:55:09.442778 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:55:09.442928 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:55:09.443130 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:55:09.443297 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:55:09.443528 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:55:09.443667 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:55:09.443834 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:55:09.444023 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:55:09.444218 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:55:09.444453 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:55:09.444591 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:55:09.444765 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:55:09.444899 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-846842-8-iscsi {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:55:09.445083 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:55:09.445224 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:55:09.445410 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:55:09.445540 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:55:09.445730 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:55:09.445857 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:55:09.446057 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:55:09.446197 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:55:09.446372 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:55:09.446502 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:55:09.446726 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:55:09.446878 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-846842-8-iscsi {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:55:09.447042 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:55:09.447241 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:55:09.447378 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:55:09.447506 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:55:09.447690 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:55:09.447826 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:55:09.448011 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:55:09.448148 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:55:09.448328 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:55:09.448464 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:55:09.448644 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:55:09.448780 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:55:09.448958 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:55:09.449099 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:55:09.449306 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:55:09.449444 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:55:09.449572 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:55:09.449725 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:55:09.449854 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:55:09.450059 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:55:09.450197 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:55:09.450384 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:55:09.450514 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:55:09.450708 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:55:09.450922 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:55:09.451050 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:55:09.451173 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:55:09.451331 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:55:09.451458 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:55:09.451589 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:55:09.451724 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:55:09.451859 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:55:09.451990 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:55:09.452175 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:55:09.452320 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:55:09.452447 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:55:09.452607 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:55:09.452735 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:55:09.452860 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:55:09.452991 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:55:09.453116 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:55:09.453254 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:55:09.453387 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:55:09.453551 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:55:09.453688 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:55:09.453855 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:55:09.454010 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:55:09.454151 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:55:09.454336 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:55:09.454475 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:55:09.454682 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:55:09.454812 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:55:09.454945 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:55:09.455072 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:55:09.455203 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:55:09.455350 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:55:09.455474 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:55:09.455611 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:55:09.455781 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:55:09.455913 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:55:09.456093 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:55:09.456229 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:55:09.456404 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:55:09.456541 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:55:09.457250 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:55:09.457388 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:55:09.457564 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:55:09.457703 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:55:09.457874 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:55:09.458013 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.20 {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:55:09.458184 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:55:09.458314 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.20 {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:55:09.458492 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:55:09.458622 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:55:09.458892 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:55:09.459030 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:55:09.459207 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:55:09.459462 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:55:09.459588 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:55:09.459712 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:55:09.459851 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:55:09.459986 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:55:09.460154 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:55:09.460290 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:55:09.460460 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:55:09.460589 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.20 {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:55:09.460765 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:55:09.460902 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.20 {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:55:09.461069 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:55:09.461199 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:55:09.461385 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:55:09.461513 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:55:09.461717 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:55:09.461853 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:55:09.462020 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:55:09.462159 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:55:09.462284 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:55:09.462407 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:55:09.462544 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:55:09.462660 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:55:09.462838 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:55:09.462966 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:55:09.463152 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:55:09.463298 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:55:09.463483 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:55:09.463620 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:55:09.463788 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:55:09.463918 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:55:09.464091 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:55:09.464220 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:55:09.464388 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:55:09.464523 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:55:09.464725 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:55:09.464860 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:55:09.464997 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:55:09.465131 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:55:09.465257 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:55:09.465382 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:55:09.465552 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:55:09.465688 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:55:09.465854 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:55:09.465991 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:55:09.466154 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:55:09.466290 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:55:09.466455 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:55:09.466584 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:55:09.466758 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:55:09.466900 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:55:09.467058 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:55:09.467187 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:55:09.467396 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:55:09.467536 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:55:09.467707 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:55:09.467851 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:55:09.468009 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:55:09.468121 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:55:09.468311 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:55:09.468433 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:55:09.468810 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:55:09.468965 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:55:09.469104 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:55:09.469231 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:55:09.469231 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:55:09.469555 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:55:09.469555 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:55:09.469801 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:55:09.469928 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:55:09.470051 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:55:09.470176 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:55:09.470299 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:55:09.470423 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:55:09.470557 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:55:09.470684 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:55:09.470808 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:55:09.470969 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:55:09.471098 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:55:09.471289 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:55:09.471430 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:55:09.471589 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:55:09.471719 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:55:09.471902 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:55:09.472038 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:55:09.472199 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:55:09.472374 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:55:09.473067 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:55:09.473229 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:55:09.473364 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:55:09.473621 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:55:09.473760 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:55:09.473980 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:55:09.474100 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:55:09.474292 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:55:09.474420 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:55:09.474603 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:55:09.474818 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:55:09.475009 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:55:09.475256 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:55:09.475414 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:55:09.475566 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:55:09.475836 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:55:09.476022 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:55:09.476173 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:55:09.476366 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:55:09.476523 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:55:09.476743 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:55:09.476895 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:55:09.477056 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:55:09.477344 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:55:09.477500 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:55:09.477646 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:55:09.477857 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:55:09.478028 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:55:09.478234 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:55:09.478393 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:55:09.478539 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:55:09.478850 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:55:09.479016 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:55:09.479311 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:55:09.479460 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:55:09.479599 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:55:09.479789 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:55:09.479960 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:55:09.480107 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:55:09.480404 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:55:09.480558 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:55:09.480746 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.480953 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:55:09.481117 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.481418 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.481581 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.481727 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.481985 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.482139 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.482382 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.482559 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.482717 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.483005 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.483179 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.483357 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.483589 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.483762 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.483960 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.484146 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.484285 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.484578 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.484728 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.484885 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.485139 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.485307 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.485522 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.485668 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.485827 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.486156 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.486308 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.486452 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.486693 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.486863 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.487078 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.487272 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.487437 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.487740 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.487906 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.488080 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.488316 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.488480 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.488761 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.488920 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.489075 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.489347 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.489516 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.489700 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.489905 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.490054 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.490317 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.490465 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.490631 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.490914 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.491066 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.491277 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.491484 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.491635 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.491907 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.492055 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.492208 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.492511 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.492663 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.492820 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.493056 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.493206 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.493416 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.493587 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.493735 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.494063 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.494210 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.494360 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.494641 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.494793 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.494985 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.495182 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.495384 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.495630 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.495779 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.495921 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.496226 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.496398 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.496543 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.496763 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.496914 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.497125 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.497295 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.497460 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.497741 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.497900 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.498061 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.498311 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.498478 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.498685 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.498876 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.499024 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.499322 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.499473 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.499634 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.499912 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.500080 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.500224 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.500456 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.500617 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.500820 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.500998 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.501144 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.501441 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.501601 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.501753 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.502004 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.502157 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.502357 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.502543 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.502692 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.502964 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.503111 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.503286 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.504106 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.504261 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.504424 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.504655 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.504807 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.505035 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.505182 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.505366 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.505666 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.505832 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.505988 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.506210 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.506373 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.506633 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.506791 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.506946 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.507211 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.507423 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.507595 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.507769 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.508039 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.508212 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.508358 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.508512 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.508789 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.508954 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.509119 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.509334 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.509503 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.509700 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.509847 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.510052 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.510299 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.510459 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.510631 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.510897 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.511080 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.511308 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.511502 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.511651 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.511832 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.512064 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.512215 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.512430 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.512578 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.512723 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.513049 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.513202 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.513346 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.513603 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.513754 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.514017 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.514175 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.514328 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.514597 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.514764 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.514950 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.515146 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.515345 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.515597 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.515744 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.515913 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.516198 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.516351 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.516497 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.516738 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.516902 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.517129 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.517287 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.517441 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.517751 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.517914 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.518072 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.518298 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.518451 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.518689 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.518835 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.518987 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.519858 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.520023 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.520219 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.520444 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.520607 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.520868 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.521034 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.521187 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.521456 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.521610 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.521798 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.522002 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.522165 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.522421 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.522568 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.522712 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.523022 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.523191 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.523365 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.523594 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.523743 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.523974 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.524150 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.524381 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.524599 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.524803 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.524947 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.525202 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.525353 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.525511 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.525727 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.525879 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.526135 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.526283 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.526472 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.526765 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.526918 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.527097 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.527344 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.527494 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.527753 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.527902 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.528056 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.528344 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.528507 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.528651 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.528874 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.529025 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.529260 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.529405 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.529574 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.529881 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.530048 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.530193 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.530411 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.530564 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.530790 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.530938 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.531103 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.531422 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.531592 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.531735 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.531990 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.532158 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.532345 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.532524 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.532672 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.532970 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.533118 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.533288 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.533548 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.533702 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.533884 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.534115 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.534279 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.534510 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.534696 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.534896 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.535150 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.535356 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.535524 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.535713 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.535876 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.536116 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.536296 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.536443 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.536737 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.536888 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.537060 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.537325 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.537477 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.537683 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.537895 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.538047 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.538297 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.538464 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.538607 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.538911 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.539078 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.539253 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.539499 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.539672 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.539846 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.540062 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.540227 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.540463 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.540612 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.540790 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.541103 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.541275 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.541429 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.541646 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.541795 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.542006 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.542184 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.542346 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.542628 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.542776 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.543130 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.543306 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.543561 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.543737 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.543935 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.544192 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.544353 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.544495 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.544732 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.544993 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.545139 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.545278 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.545457 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.545768 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.545940 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.546101 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.546307 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.546456 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.546704 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.546939 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.547084 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.547340 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.547509 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.547652 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.547936 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.548087 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.548231 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.548476 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.548628 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.548833 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.549032 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.549184 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.549439 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.549608 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.549752 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.550035 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.550187 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.550362 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.550592 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.550758 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.550978 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.551124 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.551326 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.551634 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.551787 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.551951 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.552170 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.552330 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.552525 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.552722 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.552893 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.553169 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.553320 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.553506 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.553737 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.553887 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.554170 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.554318 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.554460 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.554758 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.554910 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.555115 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.555348 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.555494 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.555697 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.555848 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.556008 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.556304 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.556475 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.556621 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.556860 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.557012 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.557208 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.557425 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.557576 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.557818 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.557976 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.558119 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.558422 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.558584 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.558985 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.559216 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.559389 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.559608 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.559780 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.559954 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.560214 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.560374 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.560516 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.560783 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.560936 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.561101 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.561321 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.561473 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.561704 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.561851 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.562006 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.562312 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.562471 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.562614 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.562848 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.562998 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.563204 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.563433 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.563577 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.563847 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.564007 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.564150 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.564425 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.564578 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.564762 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.564963 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.565113 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.565365 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.565525 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.565679 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.566469 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.566623 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.566793 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.567009 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.567161 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.567447 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.567599 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.567743 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.568033 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.568207 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.568354 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.568584 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.568734 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.568943 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.569114 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.569281 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.569546 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.569755 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.569899 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.570143 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.570313 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.570469 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.570688 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.570839 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.571032 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.571261 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.571431 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.571678 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.571825 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.571965 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.572268 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.572421 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.572588 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.572799 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.572948 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.573199 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.573349 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.573558 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.573799 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.573949 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.574172 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.574372 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.574523 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.574796 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.574967 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.575109 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.575417 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.575588 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.575745 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.575972 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.576122 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.576341 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.576515 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.576664 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.576954 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.577117 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.577270 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.577514 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.577666 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.577868 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.578051 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.578311 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.578471 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.578622 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.578777 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.579094 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.579292 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.579457 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.579666 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.579878 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.580042 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.580218 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.580365 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.580621 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.580829 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.580974 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.581233 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.581382 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.581539 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.582315 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.582489 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.582690 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.582848 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.582991 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.583328 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.583496 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.583650 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.583913 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.584063 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.584236 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.584458 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.584680 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.584866 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.585009 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.585151 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.585467 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.585634 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.585780 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.586002 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.586163 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.586361 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.586557 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.586804 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.587116 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.587426 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.587590 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.587736 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.587985 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.588140 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.588343 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.588523 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.588672 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.588968 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.589130 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.589273 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.589542 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.589706 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.589981 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.590130 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.590292 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.590572 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.590723 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.590866 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.591121 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.591327 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.591489 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.591724 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.591892 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.592109 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.592267 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.592431 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.592708 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.592868 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.593022 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.593249 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.593403 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.593633 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.593791 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.594050 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.594251 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.594457 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.594659 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.594804 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.595079 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.595293 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.595444 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.595745 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.595894 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.596066 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.596298 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.596451 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.596712 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.596872 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.597014 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.597312 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.597468 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.597650 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.597847 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.597998 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.598291 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.598456 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.598601 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.598840 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.598992 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.599199 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.599393 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.599558 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.599865 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.600077 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.600223 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.600396 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.600543 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.600889 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.601042 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.601215 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.601426 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.601586 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.601845 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.601995 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.602174 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.602417 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.602580 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.602779 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.602947 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.603104 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.603419 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.603569 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.603711 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.603982 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.604153 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.604331 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.604551 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.604701 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.604945 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.605102 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.605257 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.605549 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.605712 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.605856 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.606098 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.606281 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.606437 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.606635 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.606796 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.607075 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.607261 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.607426 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.607672 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.607825 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.608037 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.608193 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.608364 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.608666 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.608819 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.608964 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.609191 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.609342 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.609558 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.609718 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.609914 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.610199 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.610351 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.610521 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.610745 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.610897 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.611174 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.611408 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.611555 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.611788 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.612062 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.612212 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.612351 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.612504 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.612770 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.612945 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.613195 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.613458 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.613622 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.613797 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.613958 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.614102 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.614407 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.614569 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.614711 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.614934 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.615095 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.615331 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.615480 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.615622 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.615931 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.616082 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.616223 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.616486 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.616638 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.616843 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.617016 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.617163 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.617466 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.617629 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.617801 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.618019 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.618170 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.618325 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.618541 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.618712 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.618969 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.619128 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.619356 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.619585 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.619754 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.619946 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.620119 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.620269 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.620577 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.620728 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.620883 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.621111 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.621262 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.621512 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.621660 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.621831 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.622108 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.622259 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.622451 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.622658 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.622818 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.623080 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.623267 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.623412 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.623684 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.623837 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.624025 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.624217 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.624443 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.624731 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.624884 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.625220 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.625374 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.625531 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.625750 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.625901 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.626155 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.626313 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.626472 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.626784 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.626950 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.627107 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.627361 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.627513 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.627739 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.627887 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.628031 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.628352 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.629006 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.629197 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.629395 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.629545 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.629858 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.630011 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.630181 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.630390 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.630549 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.630810 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.630973 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.631117 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.631412 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.631564 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.631816 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.631964 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.632126 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.632399 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.632551 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.632741 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.632934 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.633159 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.633362 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.633520 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.633665 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.633966 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.634119 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.634277 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.634513 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.634664 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.634882 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.635028 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.635198 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.635545 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.635712 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.635857 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.636073 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.636226 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.636601 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.636766 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.636912 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.637136 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.637282 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.637453 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.637752 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.637986 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.638236 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.638406 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.638636 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.638792 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.638956 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.639302 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.639457 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.639620 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.639840 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.639992 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.640252 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.640469 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.640615 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.640859 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.641022 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.641179 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.641388 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.641540 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.641763 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.641911 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.642070 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.642388 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.642540 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.642685 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.642918 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.643070 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.643326 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.643592 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.643867 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.644021 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.644273 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.645079 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.645309 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.645471 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.645640 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.645789 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.646034 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.646181 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.646339 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.646647 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.646814 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.647021 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.647215 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.647418 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.647577 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.647801 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.647954 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.648178 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.648334 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.648480 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.648787 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.648938 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.649082 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.649318 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.649470 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.649689 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.649851 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.650002 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.650308 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.650458 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.650593 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.650848 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.651021 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.651198 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.651414 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.651558 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.651834 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.651997 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.652152 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.652413 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.652566 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.652710 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.652948 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.653115 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.653318 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.653488 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.653635 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.653923 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.654074 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.654230 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.654476 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.654629 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.654824 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.655017 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.655169 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.655522 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.655679 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.655907 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.656053 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.656196 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.656535 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.656696 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.656839 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.657054 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.657207 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.657460 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.657629 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.657774 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.658044 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.658196 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.658421 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.658568 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.658970 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.659122 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.659323 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.659647 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.660325 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.660507 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.660712 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.660861 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.661149 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.661297 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.661456 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.661719 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.661871 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.662067 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.662260 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.662410 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.662689 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.662918 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.663065 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.663316 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.663471 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.663614 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.663858 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.664037 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.664241 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.664407 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.664551 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.664858 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.665090 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.665309 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.665515 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.665662 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.665832 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.666064 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.666225 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.666371 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.666686 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.666843 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.667049 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.667282 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.667460 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.667712 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.667863 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.668033 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.668283 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.668438 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.668656 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.668853 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.669030 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.669247 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.669452 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.669614 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.669901 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.670055 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.670200 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.670427 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.670633 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.670945 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.671099 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.671293 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.671548 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.671703 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.671917 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.672181 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.672339 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.672550 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.672810 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.672966 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.673180 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.673358 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.673514 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.673812 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.673964 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.674147 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.674500 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.674654 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.674834 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.675047 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.675198 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.675563 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.676310 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.676450 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.676678 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.676856 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.677006 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.677313 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.677464 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.677606 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.677892 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.678057 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.678213 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.678436 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.678588 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.678815 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.678963 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.679117 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.679450 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.679679 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.679831 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.680057 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.680206 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.680349 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.680605 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.680831 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.681037 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.681179 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.681322 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.681533 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.681817 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.681978 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.682134 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.682272 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.682417 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.682729 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.682903 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.683050 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.683409 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.683569 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.683714 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.684146 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.684310 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.684568 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.684717 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.684865 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.685201 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.685361 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.685522 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.685828 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.685990 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.686134 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.686368 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.686541 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.686763 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.686913 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.687090 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.687435 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.687610 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.687777 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.687984 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.688137 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.688380 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.688540 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.688685 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.688985 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.689138 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.689296 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.689519 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.689683 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.689927 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.690084 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.690261 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.690538 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.690676 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.690899 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.691086 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.691309 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.691609 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.691773 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.691933 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.692147 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.692308 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.692577 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.692715 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.692893 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.693142 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.693282 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.693519 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.693651 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.693835 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.694140 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.694304 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.694447 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.694662 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.694800 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.695094 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.695253 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.695458 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.695701 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.695842 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.696095 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.696238 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.696427 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.696721 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.696891 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.697106 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.697271 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.697458 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.697760 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.697915 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.698080 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.698299 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.698451 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.698704 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.698853 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.699009 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=104010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 01 03:55:09.699340 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.699749 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.700208 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.700637 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.715476 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.715476 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.715476 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.715476 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.715476 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.715476 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.715476 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.715476 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.716979 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.716979 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.716979 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.716979 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.716979 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.716979 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.716979 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.716979 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.717454 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.717454 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.717454 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.717454 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.717454 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.717454 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.717454 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.717454 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.717930 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.717930 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.717930 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.717930 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.717930 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.717930 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.717930 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.717930 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.718374 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.718374 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.718374 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.718374 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.718374 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.718374 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.718374 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.718374 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.718851 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.718851 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.718851 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.718851 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.718851 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.718851 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.718851 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.718851 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.719342 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.719342 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.719342 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.719342 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.719342 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.719342 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.719919 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.720335 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.720834 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.721245 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.721652 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.722881 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.723325 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.723721 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.724111 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.724573 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.725006 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.725397 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.725791 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.726282 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.726686 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.727151 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.727668 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.728169 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.728585 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.728985 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.729374 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.729759 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.730145 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.730532 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.731011 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.731487 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.731894 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.732280 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.732667 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.733059 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.733708 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.734098 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.734792 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.735201 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.735630 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.736072 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.736547 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.736948 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.737328 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.737705 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.738708 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.739098 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.739510 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.739906 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.740288 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.740665 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.741123 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.741572 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.742185 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.742605 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.742995 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.743429 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.743829 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.744219 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.744595 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.744991 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.745371 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.745859 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.746320 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.746758 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.747161 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.747563 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.747949 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.748330 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.748712 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.749106 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.749485 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.749895 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.750273 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.750650 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.751026 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.751473 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.751861 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.752239 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.752617 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.752995 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.753378 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.753787 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.754172 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.754546 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.754941 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.755360 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.755746 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.756163 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.756655 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.757048 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.757425 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.757816 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.758198 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.758593 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.759054 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.759482 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.759916 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.760319 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.760983 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.761474 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.761879 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.762295 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.762701 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.763085 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.763492 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.763874 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.764278 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.764666 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.765050 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.765433 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.765830 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.766216 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.766661 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.767132 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.767553 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.767941 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.768328 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.768712 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.769188 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.769592 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.769989 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.770416 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.770822 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.771217 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.771728 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.772129 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.772570 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.772908 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.773292 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.773680 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.774074 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.774485 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.774875 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.775303 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.775804 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.776200 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.776590 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.777094 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.777486 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.777883 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.778277 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.778662 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.779057 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.779547 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.779953 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.780370 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.780773 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.781183 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.781562 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.781991 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.782373 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.782761 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.783158 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.783572 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.783946 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.784322 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.784707 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.785600 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.785978 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.786344 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.786734 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.787204 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.787643 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.788019 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.788395 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.788794 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.789169 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.789615 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.790007 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.790388 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.790767 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.791146 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.791565 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.792017 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.792440 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.792842 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.793254 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.793647 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.794029 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.794417 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.794802 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.795186 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.795612 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.796005 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.796477 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.796802 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.797241 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.797716 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.798102 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.798489 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.798877 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.799298 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.799795 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.800238 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.801168 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.801570 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.801965 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.802405 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.802793 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.803184 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.803608 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.803995 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.804383 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.804773 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.805161 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.805547 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.805941 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.806331 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.806740 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.807134 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.807665 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.808072 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.808472 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.809150 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.809532 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.810015 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.810423 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.810825 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.811214 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.811626 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:55:09.811940 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=104009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 01 03:55:09.851825 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: INFO dbcounter [None req-2370225f-e608-45a5-857a-281611ad8379 None None] Registered counter for database nova_api Jul 01 03:55:09.874528 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG oslo_db.sqlalchemy.engines [None req-2370225f-e608-45a5-857a-281611ad8379 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104010) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 01 03:55:09.882053 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG dbcounter [-] [104010] Writer thread running {{(pid=104010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 01 03:55:09.942022 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.context [None req-2370225f-e608-45a5-857a-281611ad8379 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),645b6dde-2c23-4766-a50b-4919c2bf5c2f(cell1) {{(pid=104010) load_cells /opt/stack/nova/nova/context.py:464}} Jul 01 03:55:09.945989 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG oslo_concurrency.lockutils [None req-2370225f-e608-45a5-857a-281611ad8379 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 03:55:09.947621 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG oslo_concurrency.lockutils [None req-2370225f-e608-45a5-857a-281611ad8379 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=104010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 03:55:09.948440 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG oslo_concurrency.lockutils [None req-2370225f-e608-45a5-857a-281611ad8379 None None] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 03:55:09.950422 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG oslo_concurrency.lockutils [None req-2370225f-e608-45a5-857a-281611ad8379 None None] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=104010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 03:55:09.952483 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: INFO dbcounter [None req-2370225f-e608-45a5-857a-281611ad8379 None None] Registered counter for database nova_cell0 Jul 01 03:55:09.958608 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: INFO dbcounter [None req-2370225f-e608-45a5-857a-281611ad8379 None None] Registered counter for database nova_cell1 Jul 01 03:55:09.964243 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: INFO dbcounter [None req-bd49f801-394e-488d-b87d-2ab42f99f0be None None] Registered counter for database nova_api Jul 01 03:55:09.965907 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG oslo_db.sqlalchemy.engines [None req-2370225f-e608-45a5-857a-281611ad8379 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104010) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 01 03:55:09.968151 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG oslo_db.sqlalchemy.engines [None req-2370225f-e608-45a5-857a-281611ad8379 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104010) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 01 03:55:09.974179 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG dbcounter [-] [104010] Writer thread running {{(pid=104010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 01 03:55:09.976038 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG dbcounter [-] [104010] Writer thread running {{(pid=104010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 01 03:55:09.984840 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG oslo_db.sqlalchemy.engines [None req-bd49f801-394e-488d-b87d-2ab42f99f0be None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104009) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 01 03:55:09.991795 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG dbcounter [-] [104009] Writer thread running {{(pid=104009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 01 03:55:10.047437 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.context [None req-bd49f801-394e-488d-b87d-2ab42f99f0be None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),645b6dde-2c23-4766-a50b-4919c2bf5c2f(cell1) {{(pid=104009) load_cells /opt/stack/nova/nova/context.py:464}} Jul 01 03:55:10.051885 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG oslo_concurrency.lockutils [None req-bd49f801-394e-488d-b87d-2ab42f99f0be None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 03:55:10.053439 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG oslo_concurrency.lockutils [None req-bd49f801-394e-488d-b87d-2ab42f99f0be None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=104009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 03:55:10.054212 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG oslo_concurrency.lockutils [None req-bd49f801-394e-488d-b87d-2ab42f99f0be None None] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 03:55:10.056161 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG oslo_concurrency.lockutils [None req-bd49f801-394e-488d-b87d-2ab42f99f0be None None] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=104009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 03:55:10.058091 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: INFO dbcounter [None req-bd49f801-394e-488d-b87d-2ab42f99f0be None None] Registered counter for database nova_cell0 Jul 01 03:55:10.063619 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: INFO dbcounter [None req-bd49f801-394e-488d-b87d-2ab42f99f0be None None] Registered counter for database nova_cell1 Jul 01 03:55:10.071292 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG oslo_db.sqlalchemy.engines [None req-bd49f801-394e-488d-b87d-2ab42f99f0be None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104009) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 01 03:55:10.073074 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG oslo_db.sqlalchemy.engines [None req-bd49f801-394e-488d-b87d-2ab42f99f0be None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104009) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 01 03:55:10.078449 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG dbcounter [-] [104009] Writer thread running {{(pid=104009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 01 03:55:10.083593 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG dbcounter [-] [104009] Writer thread running {{(pid=104009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 01 03:55:10.121854 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: INFO dbcounter [None req-2370225f-e608-45a5-857a-281611ad8379 None None] Registered counter for database nova_cell0 Jul 01 03:55:10.130946 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG oslo_db.sqlalchemy.engines [None req-2370225f-e608-45a5-857a-281611ad8379 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104010) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 01 03:55:10.135206 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG dbcounter [-] [104010] Writer thread running {{(pid=104010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 01 03:55:10.224907 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: INFO dbcounter [None req-bd49f801-394e-488d-b87d-2ab42f99f0be None None] Registered counter for database nova_cell0 Jul 01 03:55:10.233500 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG oslo_db.sqlalchemy.engines [None req-bd49f801-394e-488d-b87d-2ab42f99f0be None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104009) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 01 03:55:10.238677 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG dbcounter [-] [104009] Writer thread running {{(pid=104009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 01 03:55:10.513908 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: WARNING keystonemiddleware.auth_token [None req-2370225f-e608-45a5-857a-281611ad8379 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 01 03:55:10.521742 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: WARNING keystonemiddleware.auth_token [None req-2370225f-e608-45a5-857a-281611ad8379 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 01 03:55:10.548624 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: WARNING keystonemiddleware.auth_token [None req-bd49f801-394e-488d-b87d-2ab42f99f0be None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 01 03:55:10.556058 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: WARNING keystonemiddleware.auth_token [None req-bd49f801-394e-488d-b87d-2ab42f99f0be None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 01 03:55:10.867888 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: WARNING keystonemiddleware.auth_token [None req-2370225f-e608-45a5-857a-281611ad8379 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 01 03:55:10.873792 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: WARNING keystonemiddleware.auth_token [None req-2370225f-e608-45a5-857a-281611ad8379 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 01 03:55:10.879120 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55aa86d1f9c0 pid: 104010 (default app) Jul 01 03:55:10.881276 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi [None req-2370225f-e608-45a5-857a-281611ad8379 None None] Calling method '>' {{(pid=104010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 03:55:10.882469 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: INFO nova.api.openstack.requestlog [None req-2370225f-e608-45a5-857a-281611ad8379 None None] 10.222.0.20 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001795 Jul 01 03:55:10.883256 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: [pid: 104010|app: 0|req: 1/1] 10.222.0.20 () {50 vars in 788 bytes} [Fri Jul 1 03:55:10 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 03:55:10.895838 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: WARNING keystonemiddleware.auth_token [None req-bd49f801-394e-488d-b87d-2ab42f99f0be None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 01 03:55:10.901741 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: WARNING keystonemiddleware.auth_token [None req-bd49f801-394e-488d-b87d-2ab42f99f0be None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 01 03:55:10.906988 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55aa86d1f9c0 pid: 104009 (default app) Jul 01 03:56:35.374798 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi [None req-2370225f-e608-45a5-857a-281611ad8379 None None] Calling method '>' {{(pid=104010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 03:56:35.376843 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: INFO nova.api.openstack.requestlog [None req-2370225f-e608-45a5-857a-281611ad8379 None None] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001662 Jul 01 03:56:35.377742 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: [pid: 104010|app: 0|req: 2/2] 10.222.0.20 () {54 vars in 930 bytes} [Fri Jul 1 03:56:35 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 01 03:56:35.397608 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG dbcounter [-] [104009] Writing DB stats nova_api:SELECT=3 {{(pid=104009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:56:35.399415 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG dbcounter [-] [104009] Writing DB stats nova_cell1:SELECT=3 {{(pid=104009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:56:35.400582 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG dbcounter [-] [104009] Writing DB stats nova_cell0:SELECT=3 {{(pid=104009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:56:35.401772 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG dbcounter [-] [104009] Writing DB stats nova_cell0:SELECT=3 {{(pid=104009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:56:35.911538 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi [None req-ca794a29-bc05-41bb-81ad-33a77bbcd319 admin admin] Calling method '>' {{(pid=104009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 03:56:35.944153 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: INFO nova.api.openstack.requestlog [None req-ca794a29-bc05-41bb-81ad-33a77bbcd319 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.558225 Jul 01 03:56:35.945006 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: [pid: 104009|app: 0|req: 1/3] 10.222.0.20 () {60 vars in 1291 bytes} [Fri Jul 1 03:56:35 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 03:56:38.151927 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi [None req-2370225f-e608-45a5-857a-281611ad8379 None None] Calling method '>' {{(pid=104010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 03:56:38.153111 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: INFO nova.api.openstack.requestlog [None req-2370225f-e608-45a5-857a-281611ad8379 None None] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001522 Jul 01 03:56:38.153942 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: [pid: 104010|app: 0|req: 3/4] 10.222.0.20 () {54 vars in 930 bytes} [Fri Jul 1 03:56:38 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 03:56:38.260666 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi [None req-ffb2a74f-b179-415b-a4e0-bc4e0aedd2ff admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "id": "c1", "name": "cirros256", "os-flavor-access:is_public": true, "vcpus": 1, "ram": 256, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 1}} {{(pid=104009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 03:56:38.298120 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 01 03:56:38.298120 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: warnings.warn(msg) Jul 01 03:56:38.449654 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: INFO nova.api.openstack.requestlog [None req-ffb2a74f-b179-415b-a4e0-bc4e0aedd2ff admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.285930 Jul 01 03:56:38.450198 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: [pid: 104009|app: 0|req: 2/5] 10.222.0.20 () {64 vars in 1282 bytes} [Fri Jul 1 03:56:38 2022] POST /compute/v2.1/flavors => generated 407 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 01 03:56:38.473294 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG dbcounter [-] [104010] Writing DB stats nova_api:SELECT=3 {{(pid=104010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:56:38.475207 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG dbcounter [-] [104010] Writing DB stats nova_cell1:SELECT=3 {{(pid=104010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:56:38.476372 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG dbcounter [-] [104010] Writing DB stats nova_cell0:SELECT=3 {{(pid=104010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:56:38.477346 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG dbcounter [-] [104010] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=104010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:56:38.751701 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi [None req-fb89649a-633c-4506-bb00-3203ce92950f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 03:56:38.754315 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 01 03:56:38.754315 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: warnings.warn(msg) Jul 01 03:56:38.906274 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: INFO nova.api.openstack.requestlog [None req-fb89649a-633c-4506-bb00-3203ce92950f admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.440957 Jul 01 03:56:38.907484 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: [pid: 104010|app: 0|req: 4/6] 10.222.0.20 () {64 vars in 1335 bytes} [Fri Jul 1 03:56:38 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 03:56:41.057796 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi [None req-ffb2a74f-b179-415b-a4e0-bc4e0aedd2ff admin admin] Calling method '>' {{(pid=104009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 03:56:41.059176 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: INFO nova.api.openstack.requestlog [None req-ffb2a74f-b179-415b-a4e0-bc4e0aedd2ff admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002383 Jul 01 03:56:41.060000 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: [pid: 104009|app: 0|req: 3/7] 10.222.0.20 () {54 vars in 930 bytes} [Fri Jul 1 03:56:41 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 03:56:41.221201 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi [None req-2e08463a-9dd0-49ca-821c-bde49c72846f admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 5, "id": "d1", "swap": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "ram": 512, "name": "ds512M", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1}} {{(pid=104010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 03:56:41.240249 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 01 03:56:41.240249 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: warnings.warn(msg) Jul 01 03:56:41.515503 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: INFO nova.api.openstack.requestlog [None req-2e08463a-9dd0-49ca-821c-bde49c72846f admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.448498 Jul 01 03:56:41.516584 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: [pid: 104010|app: 0|req: 5/8] 10.222.0.20 () {64 vars in 1282 bytes} [Fri Jul 1 03:56:41 2022] POST /compute/v2.1/flavors => generated 404 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 01 03:56:41.537130 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi [None req-4edd1ca7-f605-4467-9d7b-45c21237bd5e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 03:56:41.540302 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 01 03:56:41.540302 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: warnings.warn(msg) Jul 01 03:56:41.655688 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: INFO nova.api.openstack.requestlog [None req-4edd1ca7-f605-4467-9d7b-45c21237bd5e admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.125443 Jul 01 03:56:41.656849 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: [pid: 104009|app: 0|req: 4/9] 10.222.0.20 () {64 vars in 1335 bytes} [Fri Jul 1 03:56:41 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 03:56:43.809084 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi [None req-2e08463a-9dd0-49ca-821c-bde49c72846f admin admin] Calling method '>' {{(pid=104010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 03:56:43.810277 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: INFO nova.api.openstack.requestlog [None req-2e08463a-9dd0-49ca-821c-bde49c72846f admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001728 Jul 01 03:56:43.810681 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: [pid: 104010|app: 0|req: 6/10] 10.222.0.20 () {54 vars in 930 bytes} [Fri Jul 1 03:56:43 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 01 03:56:43.883376 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi [None req-5a4b309f-6ca0-4fa7-9c7c-96daa88fa2e6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 10, "vcpus": 1, "rxtx_factor": 1.0, "name": "ds1G", "swap": 0, "os-flavor-access:is_public": true, "id": "d2", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 1024}} {{(pid=104009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 03:56:43.974591 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: INFO nova.api.openstack.requestlog [None req-5a4b309f-6ca0-4fa7-9c7c-96daa88fa2e6 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.156440 Jul 01 03:56:43.987265 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: [pid: 104009|app: 0|req: 5/11] 10.222.0.20 () {64 vars in 1282 bytes} [Fri Jul 1 03:56:43 2022] POST /compute/v2.1/flavors => generated 404 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 01 03:56:43.997529 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi [None req-707c5321-f731-4a15-943b-4294f5bc3bf0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 03:56:44.091702 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: INFO nova.api.openstack.requestlog [None req-707c5321-f731-4a15-943b-4294f5bc3bf0 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.100903 Jul 01 03:56:44.092762 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: [pid: 104010|app: 0|req: 7/12] 10.222.0.20 () {64 vars in 1335 bytes} [Fri Jul 1 03:56:43 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 03:56:46.503740 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi [None req-5a4b309f-6ca0-4fa7-9c7c-96daa88fa2e6 admin admin] Calling method '>' {{(pid=104009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 03:56:46.504756 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: INFO nova.api.openstack.requestlog [None req-5a4b309f-6ca0-4fa7-9c7c-96daa88fa2e6 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001498 Jul 01 03:56:46.505324 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: [pid: 104009|app: 0|req: 6/13] 10.222.0.20 () {54 vars in 930 bytes} [Fri Jul 1 03:56:46 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 03:56:46.568577 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi [None req-6c35756c-aeaa-4044-9d33-ff23456cb3bd admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "name": "ds2G", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 2, "id": "d3", "ram": 2048, "os-flavor-access:is_public": true, "disk": 10, "swap": 0}} {{(pid=104010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 03:56:46.650983 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: INFO nova.api.openstack.requestlog [None req-6c35756c-aeaa-4044-9d33-ff23456cb3bd admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.139544 Jul 01 03:56:46.651802 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: [pid: 104010|app: 0|req: 8/14] 10.222.0.20 () {64 vars in 1282 bytes} [Fri Jul 1 03:56:46 2022] POST /compute/v2.1/flavors => generated 404 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 01 03:56:46.664317 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi [None req-b8552d32-eeec-420f-aaf7-bfa17c57fe23 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 03:56:46.752019 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: INFO nova.api.openstack.requestlog [None req-b8552d32-eeec-420f-aaf7-bfa17c57fe23 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.091290 Jul 01 03:56:46.752641 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: [pid: 104009|app: 0|req: 7/15] 10.222.0.20 () {64 vars in 1335 bytes} [Fri Jul 1 03:56:46 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 03:56:48.884439 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi [None req-6c35756c-aeaa-4044-9d33-ff23456cb3bd admin admin] Calling method '>' {{(pid=104010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 03:56:48.885567 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: INFO nova.api.openstack.requestlog [None req-6c35756c-aeaa-4044-9d33-ff23456cb3bd admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001701 Jul 01 03:56:48.886448 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: [pid: 104010|app: 0|req: 9/16] 10.222.0.20 () {54 vars in 930 bytes} [Fri Jul 1 03:56:48 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 03:56:48.948707 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi [None req-bdbaf8db-eed2-40ab-b25e-92443558ec24 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "ram": 4096, "id": "d4", "rxtx_factor": 1.0, "name": "ds4G", "vcpus": 4, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 20}} {{(pid=104009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 03:56:49.080093 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: INFO nova.api.openstack.requestlog [None req-bdbaf8db-eed2-40ab-b25e-92443558ec24 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.187585 Jul 01 03:56:49.080651 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: [pid: 104009|app: 0|req: 8/17] 10.222.0.20 () {64 vars in 1282 bytes} [Fri Jul 1 03:56:48 2022] POST /compute/v2.1/flavors => generated 404 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 01 03:56:49.092901 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi [None req-6ae883c2-8f79-44d4-a733-e712bb0559ed admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 03:56:49.169112 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: INFO nova.api.openstack.requestlog [None req-6ae883c2-8f79-44d4-a733-e712bb0559ed admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.079965 Jul 01 03:56:49.169731 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: [pid: 104010|app: 0|req: 10/18] 10.222.0.20 () {64 vars in 1335 bytes} [Fri Jul 1 03:56:49 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 03:56:51.339745 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi [None req-bdbaf8db-eed2-40ab-b25e-92443558ec24 admin admin] Calling method '>' {{(pid=104009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 03:56:51.341310 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: INFO nova.api.openstack.requestlog [None req-bdbaf8db-eed2-40ab-b25e-92443558ec24 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002028 Jul 01 03:56:51.341714 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: [pid: 104009|app: 0|req: 9/19] 10.222.0.20 () {54 vars in 930 bytes} [Fri Jul 1 03:56:51 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 03:56:51.406243 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi [None req-84a34878-bf40-438d-b7ad-d7516bc53ba9 admin admin] Calling method '>' {{(pid=104010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 03:56:51.430746 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: INFO nova.api.openstack.requestlog [None req-84a34878-bf40-438d-b7ad-d7516bc53ba9 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.082923 Jul 01 03:56:51.431910 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: [pid: 104010|app: 0|req: 11/20] 10.222.0.20 () {60 vars in 1291 bytes} [Fri Jul 1 03:56:51 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 03:56:53.880264 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi [None req-bdbaf8db-eed2-40ab-b25e-92443558ec24 admin admin] Calling method '>' {{(pid=104009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 03:56:53.881351 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: INFO nova.api.openstack.requestlog [None req-bdbaf8db-eed2-40ab-b25e-92443558ec24 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001478 Jul 01 03:56:53.881741 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: [pid: 104009|app: 0|req: 10/21] 10.222.0.20 () {54 vars in 930 bytes} [Fri Jul 1 03:56:53 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 03:56:53.960413 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi [None req-8c1a2d05-b378-438f-bc93-33a5ae365bca admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "1", "os-flavor-access:is_public": true, "disk": 1, "vcpus": 1, "ram": 512, "rxtx_factor": 1.0, "name": "m1.tiny"}} {{(pid=104010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 03:56:54.038364 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: INFO nova.api.openstack.requestlog [None req-8c1a2d05-b378-438f-bc93-33a5ae365bca admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.149584 Jul 01 03:56:54.047364 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: [pid: 104010|app: 0|req: 12/22] 10.222.0.20 () {64 vars in 1282 bytes} [Fri Jul 1 03:56:53 2022] POST /compute/v2.1/flavors => generated 402 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 01 03:56:54.056555 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi [None req-5527ac17-2727-4ace-9860-a7b854264e45 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 03:56:54.164914 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: INFO nova.api.openstack.requestlog [None req-5527ac17-2727-4ace-9860-a7b854264e45 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.111983 Jul 01 03:56:54.165748 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: [pid: 104009|app: 0|req: 11/23] 10.222.0.20 () {64 vars in 1332 bytes} [Fri Jul 1 03:56:54 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 03:56:56.294238 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi [None req-8c1a2d05-b378-438f-bc93-33a5ae365bca admin admin] Calling method '>' {{(pid=104010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 03:56:56.295355 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: INFO nova.api.openstack.requestlog [None req-8c1a2d05-b378-438f-bc93-33a5ae365bca admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001508 Jul 01 03:56:56.296546 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: [pid: 104010|app: 0|req: 13/24] 10.222.0.20 () {54 vars in 930 bytes} [Fri Jul 1 03:56:56 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 03:56:56.362022 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi [None req-3249f976-b395-4c1f-94b8-0afd23c003ad admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "id": "2", "disk": 20, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 2048, "swap": 0, "rxtx_factor": 1.0, "name": "m1.small"}} {{(pid=104009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 03:56:56.471244 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: INFO nova.api.openstack.requestlog [None req-3249f976-b395-4c1f-94b8-0afd23c003ad admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.166947 Jul 01 03:56:56.472022 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: [pid: 104009|app: 0|req: 12/25] 10.222.0.20 () {64 vars in 1282 bytes} [Fri Jul 1 03:56:56 2022] POST /compute/v2.1/flavors => generated 405 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 01 03:56:56.487492 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi [None req-d3475398-e7d7-4c91-94ff-9f68845e208e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 03:56:56.586758 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: INFO nova.api.openstack.requestlog [None req-d3475398-e7d7-4c91-94ff-9f68845e208e admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.103462 Jul 01 03:56:56.587375 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: [pid: 104010|app: 0|req: 14/26] 10.222.0.20 () {64 vars in 1332 bytes} [Fri Jul 1 03:56:56 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 03:56:58.766175 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi [None req-3249f976-b395-4c1f-94b8-0afd23c003ad admin admin] Calling method '>' {{(pid=104009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 03:56:58.767598 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: INFO nova.api.openstack.requestlog [None req-3249f976-b395-4c1f-94b8-0afd23c003ad admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002313 Jul 01 03:56:58.768034 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: [pid: 104009|app: 0|req: 13/27] 10.222.0.20 () {54 vars in 930 bytes} [Fri Jul 1 03:56:58 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 03:56:58.834359 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi [None req-a2a69899-12f6-487c-b47d-808e46ad2a02 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.medium", "os-flavor-access:is_public": true, "id": "3", "ram": 4096, "vcpus": 2, "disk": 40, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0}} {{(pid=104010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 03:56:58.898326 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: INFO nova.api.openstack.requestlog [None req-a2a69899-12f6-487c-b47d-808e46ad2a02 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.123237 Jul 01 03:56:58.898950 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: [pid: 104010|app: 0|req: 15/28] 10.222.0.20 () {64 vars in 1282 bytes} [Fri Jul 1 03:56:58 2022] POST /compute/v2.1/flavors => generated 406 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 01 03:56:58.912639 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi [None req-72510223-75d9-425c-b66e-dd55a53ea47e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 03:56:58.996746 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: INFO nova.api.openstack.requestlog [None req-72510223-75d9-425c-b66e-dd55a53ea47e admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.088517 Jul 01 03:56:58.997353 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: [pid: 104009|app: 0|req: 14/29] 10.222.0.20 () {64 vars in 1332 bytes} [Fri Jul 1 03:56:58 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 03:57:01.249847 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi [None req-a2a69899-12f6-487c-b47d-808e46ad2a02 admin admin] Calling method '>' {{(pid=104010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 03:57:01.251132 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: INFO nova.api.openstack.requestlog [None req-a2a69899-12f6-487c-b47d-808e46ad2a02 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002538 Jul 01 03:57:01.251661 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: [pid: 104010|app: 0|req: 16/30] 10.222.0.20 () {54 vars in 930 bytes} [Fri Jul 1 03:57:01 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 03:57:01.328996 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi [None req-e36256d4-3157-4cf1-a649-bfb6026ea938 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "disk": 80, "id": "4", "ram": 8192, "swap": 0, "name": "m1.large", "vcpus": 4, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=104009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 03:57:01.422360 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: INFO nova.api.openstack.requestlog [None req-e36256d4-3157-4cf1-a649-bfb6026ea938 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.162410 Jul 01 03:57:01.422845 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: [pid: 104009|app: 0|req: 15/31] 10.222.0.20 () {64 vars in 1282 bytes} [Fri Jul 1 03:57:01 2022] POST /compute/v2.1/flavors => generated 405 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 01 03:57:01.436041 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi [None req-8f9555e2-459e-4e03-89ad-d7b0c1ddde63 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 03:57:01.519172 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: INFO nova.api.openstack.requestlog [None req-8f9555e2-459e-4e03-89ad-d7b0c1ddde63 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.087445 Jul 01 03:57:01.519807 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: [pid: 104010|app: 0|req: 17/32] 10.222.0.20 () {64 vars in 1332 bytes} [Fri Jul 1 03:57:01 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 03:57:03.822676 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi [None req-e36256d4-3157-4cf1-a649-bfb6026ea938 admin admin] Calling method '>' {{(pid=104009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 03:57:03.824172 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: INFO nova.api.openstack.requestlog [None req-e36256d4-3157-4cf1-a649-bfb6026ea938 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002191 Jul 01 03:57:03.824735 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: [pid: 104009|app: 0|req: 16/33] 10.222.0.20 () {54 vars in 930 bytes} [Fri Jul 1 03:57:03 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 03:57:03.890287 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi [None req-9192f052-130c-4531-93f1-2ebf7d2999c5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 16384, "rxtx_factor": 1.0, "vcpus": 8, "id": "5", "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.xlarge", "os-flavor-access:is_public": true, "swap": 0, "disk": 160}} {{(pid=104010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 03:57:03.961276 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: INFO nova.api.openstack.requestlog [None req-9192f052-130c-4531-93f1-2ebf7d2999c5 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.128261 Jul 01 03:57:03.961761 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: [pid: 104010|app: 0|req: 18/34] 10.222.0.20 () {64 vars in 1282 bytes} [Fri Jul 1 03:57:03 2022] POST /compute/v2.1/flavors => generated 408 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 01 03:57:03.976549 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi [None req-a6df8ec6-986f-4e5c-b591-3b36df5b2ad1 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 03:57:04.043911 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: INFO nova.api.openstack.requestlog [None req-a6df8ec6-986f-4e5c-b591-3b36df5b2ad1 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.071816 Jul 01 03:57:04.044723 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: [pid: 104009|app: 0|req: 17/35] 10.222.0.20 () {64 vars in 1332 bytes} [Fri Jul 1 03:57:03 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 03:57:33.541405 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi [None req-9192f052-130c-4531-93f1-2ebf7d2999c5 admin admin] Calling method '>' {{(pid=104010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 03:57:33.542427 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: INFO nova.api.openstack.requestlog [None req-9192f052-130c-4531-93f1-2ebf7d2999c5 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001467 Jul 01 03:57:33.542833 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: [pid: 104010|app: 0|req: 19/36] 10.222.0.20 () {54 vars in 930 bytes} [Fri Jul 1 03:57:33 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 03:57:33.554342 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG dbcounter [-] [104009] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=10,nova_api:SAVEPOINT=5,nova_api:RELEASE=5 {{(pid=104009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:57:33.604968 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi [None req-c4d9677c-c6bd-4ea6-b482-9ec969415179 admin admin] Calling method '>' {{(pid=104009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 03:57:33.622527 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: INFO nova.api.openstack.requestlog [None req-c4d9677c-c6bd-4ea6-b482-9ec969415179 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.072799 Jul 01 03:57:33.623098 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: [pid: 104009|app: 0|req: 18/37] 10.222.0.20 () {60 vars in 1291 bytes} [Fri Jul 1 03:57:33 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 01 03:57:34.551839 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi [None req-9192f052-130c-4531-93f1-2ebf7d2999c5 admin admin] Calling method '>' {{(pid=104010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 03:57:34.552853 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: INFO nova.api.openstack.requestlog [None req-9192f052-130c-4531-93f1-2ebf7d2999c5 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001462 Jul 01 03:57:34.553252 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: [pid: 104010|app: 0|req: 20/38] 10.222.0.20 () {56 vars in 1074 bytes} [Fri Jul 1 03:57:34 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 03:57:34.743549 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi [None req-0199b18e-4d3f-4dac-92fa-a6a0b72089ec admin admin] Calling method '>' {{(pid=104009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 03:57:34.749657 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: INFO nova.api.openstack.wsgi [None req-0199b18e-4d3f-4dac-92fa-a6a0b72089ec admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 01 03:57:34.752949 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi [None req-0199b18e-4d3f-4dac-92fa-a6a0b72089ec admin admin] Request method failure captured: Jul 01 03:57:34.752949 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 01 03:57:34.752949 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: Accept: application/json Jul 01 03:57:34.752949 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: Accept-Encoding: gzip, deflate Jul 01 03:57:34.752949 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: Connection: keep-alive Jul 01 03:57:34.752949 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: Content-Length: 0 Jul 01 03:57:34.752949 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: Host: 10.222.0.20 Jul 01 03:57:34.752949 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: Openstack-Api-Version: compute 2.90 Jul 01 03:57:34.752949 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: Openstack-System-Scope: None Jul 01 03:57:34.752949 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: User-Agent: python-novaclient Jul 01 03:57:34.752949 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: X-Auth-Token: gAAAAABivnCuzn9nmaeMmf-hdfuO8POjDSccxxzRs0fkaFZO7QOwYz6-sMCcrw9ANvzvGmOryhem1WS0iNJrgGpuaUI0jhMjksb8_1QdquVQyLyyjVDPlTlc6bfitPc9u_q9n46-E1Bw1RfSoWKjC8m7EZIHzUEHZORNJtGSXcJikfJDNhUtkUE Jul 01 03:57:34.752949 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: X-Domain-Id: None Jul 01 03:57:34.752949 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: X-Domain-Name: None Jul 01 03:57:34.752949 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: X-Identity-Status: Confirmed Jul 01 03:57:34.752949 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: X-Is-Admin-Project: True Jul 01 03:57:34.752949 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: X-Openstack-Nova-Api-Version: 2.90 Jul 01 03:57:34.752949 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: X-Project-Domain-Id: default Jul 01 03:57:34.752949 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: X-Project-Domain-Name: Default Jul 01 03:57:34.752949 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: X-Project-Id: e12b5dbdf665489f80381a9cc1ab6bd0 Jul 01 03:57:34.752949 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: X-Project-Name: admin Jul 01 03:57:34.752949 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: X-Role: reader,admin,member Jul 01 03:57:34.752949 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: X-Roles: reader,admin,member Jul 01 03:57:34.754601 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/e12b5dbdf665489f80381a9cc1ab6bd0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_e12b5dbdf665489f80381a9cc1ab6bd0", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e12b5dbdf665489f80381a9cc1ab6bd0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e12b5dbdf665489f80381a9cc1ab6bd0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}] Jul 01 03:57:34.754601 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: X-Tenant: admin Jul 01 03:57:34.754601 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: X-Tenant-Id: e12b5dbdf665489f80381a9cc1ab6bd0 Jul 01 03:57:34.754601 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: X-Tenant-Name: admin Jul 01 03:57:34.754601 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: X-User: admin Jul 01 03:57:34.754601 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: X-User-Domain-Id: default Jul 01 03:57:34.754601 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: X-User-Domain-Name: Default Jul 01 03:57:34.754601 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: X-User-Id: d62406877bb84126838f185cae41e3b4 Jul 01 03:57:34.754601 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: X-User-Name: admin Jul 01 03:57:34.754601 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: method: > Jul 01 03:57:34.754601 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: exception: Flavor 42 could not be found. Jul 01 03:57:34.754601 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: action_args: {'id': '42'} Jul 01 03:57:34.754601 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: {{(pid=104009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 03:57:34.754601 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 03:57:34.755848 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 01 03:57:34.755848 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 01 03:57:34.755848 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 01 03:57:34.755848 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 01 03:57:34.755848 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 01 03:57:34.755848 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 01 03:57:34.755848 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 01 03:57:34.755848 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 01 03:57:34.755848 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 01 03:57:34.755848 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 03:57:34.755848 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 01 03:57:34.755848 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 01 03:57:34.755848 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 01 03:57:34.755848 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: ERROR nova.api.openstack.wsgi Jul 01 03:57:34.755848 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 03:57:34.755848 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: ERROR nova.api.openstack.wsgi Jul 01 03:57:34.755848 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 03:57:34.755848 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 03:57:34.755848 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 03:57:34.757403 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 03:57:34.757403 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 03:57:34.757403 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 03:57:34.757403 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 03:57:34.757403 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 01 03:57:34.757403 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 01 03:57:34.757403 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 01 03:57:34.757403 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: ERROR nova.api.openstack.wsgi Jul 01 03:57:34.757403 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 03:57:34.757403 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: ERROR nova.api.openstack.wsgi Jul 01 03:57:34.757403 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 03:57:34.757403 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 03:57:34.757403 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 03:57:34.757403 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 03:57:34.757403 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 03:57:34.757403 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 01 03:57:34.757403 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: ERROR nova.api.openstack.wsgi Jul 01 03:57:34.757403 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi [None req-0199b18e-4d3f-4dac-92fa-a6a0b72089ec admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=104009) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 03:57:34.758962 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: INFO nova.api.openstack.requestlog [None req-0199b18e-4d3f-4dac-92fa-a6a0b72089ec admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.063087 Jul 01 03:57:34.758962 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: [pid: 104009|app: 0|req: 19/39] 10.222.0.20 () {60 vars in 1190 bytes} [Fri Jul 1 03:57:34 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 01 03:57:34.764045 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi [None req-ae4405cb-b1be-45da-8380-bee6030508ca admin admin] Calling method '>' {{(pid=104010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 03:57:34.767015 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG dbcounter [-] [104010] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=104010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:57:34.786202 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: INFO nova.api.openstack.requestlog [None req-ae4405cb-b1be-45da-8380-bee6030508ca admin admin] 10.222.0.20 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025718 Jul 01 03:57:34.786775 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: [pid: 104010|app: 0|req: 21/40] 10.222.0.20 () {60 vars in 1210 bytes} [Fri Jul 1 03:57:34 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 01 03:57:34.797579 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi [None req-16009e32-be1b-4ed2-b546-74389732794a admin admin] Calling method '>' {{(pid=104009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 03:57:34.819499 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: INFO nova.api.openstack.requestlog [None req-16009e32-be1b-4ed2-b546-74389732794a admin admin] 10.222.0.20 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025995 Jul 01 03:57:34.820058 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: [pid: 104009|app: 0|req: 20/41] 10.222.0.20 () {60 vars in 1210 bytes} [Fri Jul 1 03:57:34 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 03:57:34.829911 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi [None req-090cc3c4-652d-49f8-9460-13d4a2417f41 admin admin] Calling method '>' {{(pid=104010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 03:57:34.835846 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: INFO nova.api.openstack.wsgi [None req-090cc3c4-652d-49f8-9460-13d4a2417f41 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 01 03:57:34.839145 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi [None req-090cc3c4-652d-49f8-9460-13d4a2417f41 admin admin] Request method failure captured: Jul 01 03:57:34.839145 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 01 03:57:34.839145 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: Accept: application/json Jul 01 03:57:34.839145 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: Accept-Encoding: gzip, deflate Jul 01 03:57:34.839145 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: Connection: keep-alive Jul 01 03:57:34.839145 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: Content-Length: 0 Jul 01 03:57:34.839145 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: Host: 10.222.0.20 Jul 01 03:57:34.839145 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: Openstack-Api-Version: compute 2.90 Jul 01 03:57:34.839145 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: Openstack-System-Scope: None Jul 01 03:57:34.839145 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: User-Agent: python-novaclient Jul 01 03:57:34.839145 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: X-Auth-Token: gAAAAABivnCuzn9nmaeMmf-hdfuO8POjDSccxxzRs0fkaFZO7QOwYz6-sMCcrw9ANvzvGmOryhem1WS0iNJrgGpuaUI0jhMjksb8_1QdquVQyLyyjVDPlTlc6bfitPc9u_q9n46-E1Bw1RfSoWKjC8m7EZIHzUEHZORNJtGSXcJikfJDNhUtkUE Jul 01 03:57:34.839145 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: X-Domain-Id: None Jul 01 03:57:34.839145 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: X-Domain-Name: None Jul 01 03:57:34.839145 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: X-Identity-Status: Confirmed Jul 01 03:57:34.839145 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: X-Is-Admin-Project: True Jul 01 03:57:34.839145 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: X-Openstack-Nova-Api-Version: 2.90 Jul 01 03:57:34.839145 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: X-Project-Domain-Id: default Jul 01 03:57:34.839145 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: X-Project-Domain-Name: Default Jul 01 03:57:34.839145 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: X-Project-Id: e12b5dbdf665489f80381a9cc1ab6bd0 Jul 01 03:57:34.839145 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: X-Project-Name: admin Jul 01 03:57:34.839145 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: X-Role: reader,admin,member Jul 01 03:57:34.839145 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: X-Roles: reader,admin,member Jul 01 03:57:34.840797 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/e12b5dbdf665489f80381a9cc1ab6bd0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_e12b5dbdf665489f80381a9cc1ab6bd0", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e12b5dbdf665489f80381a9cc1ab6bd0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e12b5dbdf665489f80381a9cc1ab6bd0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}] Jul 01 03:57:34.840797 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: X-Tenant: admin Jul 01 03:57:34.840797 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: X-Tenant-Id: e12b5dbdf665489f80381a9cc1ab6bd0 Jul 01 03:57:34.840797 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: X-Tenant-Name: admin Jul 01 03:57:34.840797 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: X-User: admin Jul 01 03:57:34.840797 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: X-User-Domain-Id: default Jul 01 03:57:34.840797 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: X-User-Domain-Name: Default Jul 01 03:57:34.840797 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: X-User-Id: d62406877bb84126838f185cae41e3b4 Jul 01 03:57:34.840797 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: X-User-Name: admin Jul 01 03:57:34.840797 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: method: > Jul 01 03:57:34.840797 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: exception: Flavor 42 could not be found. Jul 01 03:57:34.840797 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: action_args: {'id': '42'} Jul 01 03:57:34.840797 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: {{(pid=104010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 03:57:34.840797 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 03:57:34.841792 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 01 03:57:34.841792 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 01 03:57:34.841792 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 01 03:57:34.841792 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 01 03:57:34.841792 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 01 03:57:34.841792 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 01 03:57:34.841792 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 01 03:57:34.841792 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 01 03:57:34.841792 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 01 03:57:34.841792 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 03:57:34.841792 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 01 03:57:34.841792 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 01 03:57:34.841792 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 01 03:57:34.841792 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: ERROR nova.api.openstack.wsgi Jul 01 03:57:34.841792 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 03:57:34.841792 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: ERROR nova.api.openstack.wsgi Jul 01 03:57:34.841792 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 03:57:34.841792 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 03:57:34.841792 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 03:57:34.843024 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 03:57:34.843024 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 03:57:34.843024 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 03:57:34.843024 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 03:57:34.843024 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 01 03:57:34.843024 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 01 03:57:34.843024 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 01 03:57:34.843024 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: ERROR nova.api.openstack.wsgi Jul 01 03:57:34.843024 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 03:57:34.843024 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: ERROR nova.api.openstack.wsgi Jul 01 03:57:34.843024 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 03:57:34.843024 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 03:57:34.843024 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 03:57:34.843024 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 03:57:34.843024 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 03:57:34.843024 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 01 03:57:34.843024 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: ERROR nova.api.openstack.wsgi Jul 01 03:57:34.843024 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi [None req-090cc3c4-652d-49f8-9460-13d4a2417f41 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=104010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 03:57:34.846901 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: INFO nova.api.openstack.requestlog [None req-090cc3c4-652d-49f8-9460-13d4a2417f41 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.014586 Jul 01 03:57:34.846901 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: [pid: 104010|app: 0|req: 22/42] 10.222.0.20 () {60 vars in 1190 bytes} [Fri Jul 1 03:57:34 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 01 03:57:35.683507 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi [None req-16009e32-be1b-4ed2-b546-74389732794a admin admin] Calling method '>' {{(pid=104009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 03:57:35.684814 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: INFO nova.api.openstack.requestlog [None req-16009e32-be1b-4ed2-b546-74389732794a admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001567 Jul 01 03:57:35.685213 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: [pid: 104009|app: 0|req: 21/43] 10.222.0.20 () {56 vars in 1074 bytes} [Fri Jul 1 03:57:35 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 03:57:35.874362 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi [None req-431f246c-ef9f-48d9-8fad-ba65f0b54cd3 admin admin] Calling method '>' {{(pid=104010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 03:57:35.879846 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: INFO nova.api.openstack.wsgi [None req-431f246c-ef9f-48d9-8fad-ba65f0b54cd3 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 01 03:57:35.881418 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi [None req-431f246c-ef9f-48d9-8fad-ba65f0b54cd3 admin admin] Request method failure captured: Jul 01 03:57:35.881418 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 01 03:57:35.881418 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: Accept: application/json Jul 01 03:57:35.881418 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: Accept-Encoding: gzip, deflate Jul 01 03:57:35.881418 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: Connection: keep-alive Jul 01 03:57:35.881418 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: Content-Length: 0 Jul 01 03:57:35.881418 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: Host: 10.222.0.20 Jul 01 03:57:35.881418 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: Openstack-Api-Version: compute 2.90 Jul 01 03:57:35.881418 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: Openstack-System-Scope: None Jul 01 03:57:35.881418 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: User-Agent: python-novaclient Jul 01 03:57:35.881418 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: X-Auth-Token: gAAAAABivnCv8ZD9LDZHMcyb2aQSNIRJzsgPULJaqx5Tm6A_aio0H3ctqus0GY3Yuy1vGeku0kUgf81HMUXFZVEI1Z6Jl9Mpa094OjA02af2Ux_3M1SMgQdL-bxrNmpddQkwoqt58kLzdxwhy46jSz88a0-LDgAbN7_Wnq_z_SuUQVIRuX8APTU Jul 01 03:57:35.881418 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: X-Domain-Id: None Jul 01 03:57:35.881418 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: X-Domain-Name: None Jul 01 03:57:35.881418 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: X-Identity-Status: Confirmed Jul 01 03:57:35.881418 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: X-Is-Admin-Project: True Jul 01 03:57:35.881418 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: X-Openstack-Nova-Api-Version: 2.90 Jul 01 03:57:35.881418 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: X-Project-Domain-Id: default Jul 01 03:57:35.881418 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: X-Project-Domain-Name: Default Jul 01 03:57:35.881418 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: X-Project-Id: e12b5dbdf665489f80381a9cc1ab6bd0 Jul 01 03:57:35.881418 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: X-Project-Name: admin Jul 01 03:57:35.881418 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: X-Role: reader,admin,member Jul 01 03:57:35.881418 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: X-Roles: reader,admin,member Jul 01 03:57:35.882752 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/e12b5dbdf665489f80381a9cc1ab6bd0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_e12b5dbdf665489f80381a9cc1ab6bd0", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e12b5dbdf665489f80381a9cc1ab6bd0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e12b5dbdf665489f80381a9cc1ab6bd0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}] Jul 01 03:57:35.882752 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: X-Tenant: admin Jul 01 03:57:35.882752 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: X-Tenant-Id: e12b5dbdf665489f80381a9cc1ab6bd0 Jul 01 03:57:35.882752 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: X-Tenant-Name: admin Jul 01 03:57:35.882752 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: X-User: admin Jul 01 03:57:35.882752 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: X-User-Domain-Id: default Jul 01 03:57:35.882752 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: X-User-Domain-Name: Default Jul 01 03:57:35.882752 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: X-User-Id: d62406877bb84126838f185cae41e3b4 Jul 01 03:57:35.882752 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: X-User-Name: admin Jul 01 03:57:35.882752 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: method: > Jul 01 03:57:35.882752 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: exception: Flavor 84 could not be found. Jul 01 03:57:35.882752 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: action_args: {'id': '84'} Jul 01 03:57:35.882752 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: {{(pid=104010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 03:57:35.882752 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 03:57:35.883567 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 01 03:57:35.883567 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 01 03:57:35.883567 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 01 03:57:35.883567 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 01 03:57:35.883567 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 01 03:57:35.883567 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 01 03:57:35.883567 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 01 03:57:35.883567 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 01 03:57:35.883567 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 01 03:57:35.883567 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 03:57:35.883567 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 01 03:57:35.883567 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 01 03:57:35.883567 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 01 03:57:35.883567 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: ERROR nova.api.openstack.wsgi Jul 01 03:57:35.883567 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 03:57:35.883567 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: ERROR nova.api.openstack.wsgi Jul 01 03:57:35.883567 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 03:57:35.883567 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 03:57:35.883567 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 03:57:35.884968 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 03:57:35.884968 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 03:57:35.884968 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 03:57:35.884968 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 03:57:35.884968 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 01 03:57:35.884968 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 01 03:57:35.884968 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 01 03:57:35.884968 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: ERROR nova.api.openstack.wsgi Jul 01 03:57:35.884968 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 03:57:35.884968 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: ERROR nova.api.openstack.wsgi Jul 01 03:57:35.884968 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 03:57:35.884968 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 03:57:35.884968 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 03:57:35.884968 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 03:57:35.884968 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 03:57:35.884968 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 01 03:57:35.884968 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: ERROR nova.api.openstack.wsgi Jul 01 03:57:35.884968 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi [None req-431f246c-ef9f-48d9-8fad-ba65f0b54cd3 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=104010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 03:57:35.886281 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: INFO nova.api.openstack.requestlog [None req-431f246c-ef9f-48d9-8fad-ba65f0b54cd3 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.061610 Jul 01 03:57:35.886281 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: [pid: 104010|app: 0|req: 23/44] 10.222.0.20 () {60 vars in 1190 bytes} [Fri Jul 1 03:57:35 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 01 03:57:35.893186 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi [None req-95f69cf4-0f43-4a57-87f0-2fd40808c011 admin admin] Calling method '>' {{(pid=104009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 03:57:35.906998 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: INFO nova.api.openstack.requestlog [None req-95f69cf4-0f43-4a57-87f0-2fd40808c011 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017416 Jul 01 03:57:35.907562 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: [pid: 104009|app: 0|req: 22/45] 10.222.0.20 () {60 vars in 1210 bytes} [Fri Jul 1 03:57:35 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 03:57:35.916919 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi [None req-2d554ec3-b26b-46bb-a561-337eeaffd674 admin admin] Calling method '>' {{(pid=104010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 03:57:35.930710 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: INFO nova.api.openstack.requestlog [None req-2d554ec3-b26b-46bb-a561-337eeaffd674 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017349 Jul 01 03:57:35.931251 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: [pid: 104010|app: 0|req: 24/46] 10.222.0.20 () {60 vars in 1210 bytes} [Fri Jul 1 03:57:35 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 01 03:57:35.941450 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi [None req-fccc8e27-c959-4e94-ac7b-1f4d9c4f27ef admin admin] Calling method '>' {{(pid=104009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 03:57:35.946823 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: INFO nova.api.openstack.wsgi [None req-fccc8e27-c959-4e94-ac7b-1f4d9c4f27ef admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 01 03:57:35.948368 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi [None req-fccc8e27-c959-4e94-ac7b-1f4d9c4f27ef admin admin] Request method failure captured: Jul 01 03:57:35.948368 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 01 03:57:35.948368 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: Accept: application/json Jul 01 03:57:35.948368 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: Accept-Encoding: gzip, deflate Jul 01 03:57:35.948368 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: Connection: keep-alive Jul 01 03:57:35.948368 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: Content-Length: 0 Jul 01 03:57:35.948368 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: Host: 10.222.0.20 Jul 01 03:57:35.948368 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: Openstack-Api-Version: compute 2.90 Jul 01 03:57:35.948368 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: Openstack-System-Scope: None Jul 01 03:57:35.948368 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: User-Agent: python-novaclient Jul 01 03:57:35.948368 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: X-Auth-Token: gAAAAABivnCv8ZD9LDZHMcyb2aQSNIRJzsgPULJaqx5Tm6A_aio0H3ctqus0GY3Yuy1vGeku0kUgf81HMUXFZVEI1Z6Jl9Mpa094OjA02af2Ux_3M1SMgQdL-bxrNmpddQkwoqt58kLzdxwhy46jSz88a0-LDgAbN7_Wnq_z_SuUQVIRuX8APTU Jul 01 03:57:35.948368 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: X-Domain-Id: None Jul 01 03:57:35.948368 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: X-Domain-Name: None Jul 01 03:57:35.948368 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: X-Identity-Status: Confirmed Jul 01 03:57:35.948368 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: X-Is-Admin-Project: True Jul 01 03:57:35.948368 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: X-Openstack-Nova-Api-Version: 2.90 Jul 01 03:57:35.948368 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: X-Project-Domain-Id: default Jul 01 03:57:35.948368 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: X-Project-Domain-Name: Default Jul 01 03:57:35.948368 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: X-Project-Id: e12b5dbdf665489f80381a9cc1ab6bd0 Jul 01 03:57:35.948368 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: X-Project-Name: admin Jul 01 03:57:35.948368 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: X-Role: reader,admin,member Jul 01 03:57:35.948368 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: X-Roles: reader,admin,member Jul 01 03:57:35.949866 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/e12b5dbdf665489f80381a9cc1ab6bd0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_e12b5dbdf665489f80381a9cc1ab6bd0", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e12b5dbdf665489f80381a9cc1ab6bd0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e12b5dbdf665489f80381a9cc1ab6bd0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}] Jul 01 03:57:35.949866 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: X-Tenant: admin Jul 01 03:57:35.949866 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: X-Tenant-Id: e12b5dbdf665489f80381a9cc1ab6bd0 Jul 01 03:57:35.949866 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: X-Tenant-Name: admin Jul 01 03:57:35.949866 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: X-User: admin Jul 01 03:57:35.949866 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: X-User-Domain-Id: default Jul 01 03:57:35.949866 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: X-User-Domain-Name: Default Jul 01 03:57:35.949866 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: X-User-Id: d62406877bb84126838f185cae41e3b4 Jul 01 03:57:35.949866 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: X-User-Name: admin Jul 01 03:57:35.949866 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: method: > Jul 01 03:57:35.949866 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: exception: Flavor 84 could not be found. Jul 01 03:57:35.949866 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: action_args: {'id': '84'} Jul 01 03:57:35.949866 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: {{(pid=104009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 03:57:35.949866 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 03:57:35.951542 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 01 03:57:35.951542 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 01 03:57:35.951542 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 01 03:57:35.951542 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 01 03:57:35.951542 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 01 03:57:35.951542 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 01 03:57:35.951542 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 01 03:57:35.951542 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 01 03:57:35.951542 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 01 03:57:35.951542 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 03:57:35.951542 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 01 03:57:35.951542 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 01 03:57:35.951542 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 01 03:57:35.951542 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: ERROR nova.api.openstack.wsgi Jul 01 03:57:35.951542 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 03:57:35.951542 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: ERROR nova.api.openstack.wsgi Jul 01 03:57:35.951542 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 03:57:35.951542 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 03:57:35.951542 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 03:57:35.952799 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 03:57:35.952799 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 03:57:35.952799 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 03:57:35.952799 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 03:57:35.952799 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 01 03:57:35.952799 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 01 03:57:35.952799 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 01 03:57:35.952799 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: ERROR nova.api.openstack.wsgi Jul 01 03:57:35.952799 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 03:57:35.952799 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: ERROR nova.api.openstack.wsgi Jul 01 03:57:35.952799 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 03:57:35.952799 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 03:57:35.952799 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 03:57:35.952799 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 03:57:35.952799 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 03:57:35.952799 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 01 03:57:35.952799 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: ERROR nova.api.openstack.wsgi Jul 01 03:57:35.952799 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi [None req-fccc8e27-c959-4e94-ac7b-1f4d9c4f27ef admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=104009) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 03:57:35.953997 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: INFO nova.api.openstack.requestlog [None req-fccc8e27-c959-4e94-ac7b-1f4d9c4f27ef admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012092 Jul 01 03:57:35.953997 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: [pid: 104009|app: 0|req: 23/47] 10.222.0.20 () {60 vars in 1190 bytes} [Fri Jul 1 03:57:35 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 01 03:57:36.767543 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi [None req-2d554ec3-b26b-46bb-a561-337eeaffd674 admin admin] Calling method '>' {{(pid=104010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 03:57:36.768624 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: INFO nova.api.openstack.requestlog [None req-2d554ec3-b26b-46bb-a561-337eeaffd674 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001529 Jul 01 03:57:36.769024 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: [pid: 104010|app: 0|req: 25/48] 10.222.0.20 () {56 vars in 1074 bytes} [Fri Jul 1 03:57:36 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 03:57:36.968803 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi [None req-4d2c094f-1cc5-4053-8b5c-79966eec2ef4 admin admin] Calling method '>' {{(pid=104009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 03:57:36.975906 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: INFO nova.api.openstack.wsgi [None req-4d2c094f-1cc5-4053-8b5c-79966eec2ef4 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 01 03:57:36.977406 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi [None req-4d2c094f-1cc5-4053-8b5c-79966eec2ef4 admin admin] Request method failure captured: Jul 01 03:57:36.977406 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 01 03:57:36.977406 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: Accept: application/json Jul 01 03:57:36.977406 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: Accept-Encoding: gzip, deflate Jul 01 03:57:36.977406 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: Connection: keep-alive Jul 01 03:57:36.977406 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: Content-Length: 0 Jul 01 03:57:36.977406 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: Host: 10.222.0.20 Jul 01 03:57:36.977406 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: Openstack-Api-Version: compute 2.90 Jul 01 03:57:36.977406 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: Openstack-System-Scope: None Jul 01 03:57:36.977406 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: User-Agent: python-novaclient Jul 01 03:57:36.977406 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: X-Auth-Token: gAAAAABivnCwUBAlpPLqSNViGlT0RTSEkxHSrm0qzw_DSrHoDFndPOrRmD9bfB1o5MTioloPrFC9zRzBvMpQMcrDzJP3AtPNUG3NKemevA8QeOnZEUzTiRZ1uelexsV185yyKaGSotMltCfeJ3jDhwQ4W3QnsLAZcvZTF23YUf__4RKGyHxDy2I Jul 01 03:57:36.977406 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: X-Domain-Id: None Jul 01 03:57:36.977406 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: X-Domain-Name: None Jul 01 03:57:36.977406 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: X-Identity-Status: Confirmed Jul 01 03:57:36.977406 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: X-Is-Admin-Project: True Jul 01 03:57:36.977406 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: X-Openstack-Nova-Api-Version: 2.90 Jul 01 03:57:36.977406 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: X-Project-Domain-Id: default Jul 01 03:57:36.977406 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: X-Project-Domain-Name: Default Jul 01 03:57:36.977406 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: X-Project-Id: e12b5dbdf665489f80381a9cc1ab6bd0 Jul 01 03:57:36.977406 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: X-Project-Name: admin Jul 01 03:57:36.977406 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: X-Role: reader,admin,member Jul 01 03:57:36.977406 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: X-Roles: reader,admin,member Jul 01 03:57:36.978711 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/e12b5dbdf665489f80381a9cc1ab6bd0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_e12b5dbdf665489f80381a9cc1ab6bd0", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e12b5dbdf665489f80381a9cc1ab6bd0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e12b5dbdf665489f80381a9cc1ab6bd0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}] Jul 01 03:57:36.978711 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: X-Tenant: admin Jul 01 03:57:36.978711 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: X-Tenant-Id: e12b5dbdf665489f80381a9cc1ab6bd0 Jul 01 03:57:36.978711 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: X-Tenant-Name: admin Jul 01 03:57:36.978711 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: X-User: admin Jul 01 03:57:36.978711 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: X-User-Domain-Id: default Jul 01 03:57:36.978711 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: X-User-Domain-Name: Default Jul 01 03:57:36.978711 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: X-User-Id: d62406877bb84126838f185cae41e3b4 Jul 01 03:57:36.978711 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: X-User-Name: admin Jul 01 03:57:36.978711 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: method: > Jul 01 03:57:36.978711 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: exception: Flavor 451 could not be found. Jul 01 03:57:36.978711 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: action_args: {'id': '451'} Jul 01 03:57:36.978711 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: {{(pid=104009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 03:57:36.978711 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 03:57:36.979527 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 01 03:57:36.979527 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 01 03:57:36.979527 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 01 03:57:36.979527 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 01 03:57:36.979527 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 01 03:57:36.979527 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 01 03:57:36.979527 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 01 03:57:36.979527 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 01 03:57:36.979527 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 01 03:57:36.979527 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 03:57:36.979527 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 01 03:57:36.979527 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 01 03:57:36.979527 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 01 03:57:36.979527 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: ERROR nova.api.openstack.wsgi Jul 01 03:57:36.979527 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 03:57:36.979527 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: ERROR nova.api.openstack.wsgi Jul 01 03:57:36.979527 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 03:57:36.979527 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 03:57:36.979527 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 03:57:36.980573 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 03:57:36.980573 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 03:57:36.980573 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 03:57:36.980573 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 03:57:36.980573 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 01 03:57:36.980573 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 01 03:57:36.980573 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 01 03:57:36.980573 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: ERROR nova.api.openstack.wsgi Jul 01 03:57:36.980573 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 03:57:36.980573 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: ERROR nova.api.openstack.wsgi Jul 01 03:57:36.980573 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 03:57:36.980573 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 03:57:36.980573 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 03:57:36.980573 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 03:57:36.980573 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 03:57:36.980573 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 01 03:57:36.980573 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: ERROR nova.api.openstack.wsgi Jul 01 03:57:36.980573 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi [None req-4d2c094f-1cc5-4053-8b5c-79966eec2ef4 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=104009) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 03:57:36.982129 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: INFO nova.api.openstack.requestlog [None req-4d2c094f-1cc5-4053-8b5c-79966eec2ef4 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.062785 Jul 01 03:57:36.982129 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: [pid: 104009|app: 0|req: 24/49] 10.222.0.20 () {60 vars in 1193 bytes} [Fri Jul 1 03:57:36 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 01 03:57:36.988849 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi [None req-ef1fcca2-34f7-423d-ab36-1bc7883f7baf admin admin] Calling method '>' {{(pid=104010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 03:57:37.005215 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: INFO nova.api.openstack.requestlog [None req-ef1fcca2-34f7-423d-ab36-1bc7883f7baf admin admin] 10.222.0.20 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019851 Jul 01 03:57:37.015665 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: [pid: 104010|app: 0|req: 26/50] 10.222.0.20 () {60 vars in 1210 bytes} [Fri Jul 1 03:57:36 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 03:57:37.023925 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi [None req-94e60036-143d-40f5-b1ba-6937720d9ce7 admin admin] Calling method '>' {{(pid=104009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 03:57:37.037623 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: INFO nova.api.openstack.requestlog [None req-94e60036-143d-40f5-b1ba-6937720d9ce7 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017275 Jul 01 03:57:37.038160 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: [pid: 104009|app: 0|req: 25/51] 10.222.0.20 () {60 vars in 1210 bytes} [Fri Jul 1 03:57:37 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 03:57:37.048079 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi [None req-24bf5add-5ec9-46fe-826d-6b22c1d8e3c1 admin admin] Calling method '>' {{(pid=104010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 03:57:37.053785 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: INFO nova.api.openstack.wsgi [None req-24bf5add-5ec9-46fe-826d-6b22c1d8e3c1 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 01 03:57:37.055302 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi [None req-24bf5add-5ec9-46fe-826d-6b22c1d8e3c1 admin admin] Request method failure captured: Jul 01 03:57:37.055302 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 01 03:57:37.055302 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: Accept: application/json Jul 01 03:57:37.055302 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: Accept-Encoding: gzip, deflate Jul 01 03:57:37.055302 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: Connection: keep-alive Jul 01 03:57:37.055302 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: Content-Length: 0 Jul 01 03:57:37.055302 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: Host: 10.222.0.20 Jul 01 03:57:37.055302 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: Openstack-Api-Version: compute 2.90 Jul 01 03:57:37.055302 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: Openstack-System-Scope: None Jul 01 03:57:37.055302 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: User-Agent: python-novaclient Jul 01 03:57:37.055302 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: X-Auth-Token: gAAAAABivnCwUBAlpPLqSNViGlT0RTSEkxHSrm0qzw_DSrHoDFndPOrRmD9bfB1o5MTioloPrFC9zRzBvMpQMcrDzJP3AtPNUG3NKemevA8QeOnZEUzTiRZ1uelexsV185yyKaGSotMltCfeJ3jDhwQ4W3QnsLAZcvZTF23YUf__4RKGyHxDy2I Jul 01 03:57:37.055302 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: X-Domain-Id: None Jul 01 03:57:37.055302 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: X-Domain-Name: None Jul 01 03:57:37.055302 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: X-Identity-Status: Confirmed Jul 01 03:57:37.055302 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: X-Is-Admin-Project: True Jul 01 03:57:37.055302 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: X-Openstack-Nova-Api-Version: 2.90 Jul 01 03:57:37.055302 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: X-Project-Domain-Id: default Jul 01 03:57:37.055302 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: X-Project-Domain-Name: Default Jul 01 03:57:37.055302 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: X-Project-Id: e12b5dbdf665489f80381a9cc1ab6bd0 Jul 01 03:57:37.055302 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: X-Project-Name: admin Jul 01 03:57:37.055302 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: X-Role: reader,admin,member Jul 01 03:57:37.055302 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: X-Roles: reader,admin,member Jul 01 03:57:37.056827 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/e12b5dbdf665489f80381a9cc1ab6bd0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_e12b5dbdf665489f80381a9cc1ab6bd0", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e12b5dbdf665489f80381a9cc1ab6bd0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e12b5dbdf665489f80381a9cc1ab6bd0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}] Jul 01 03:57:37.056827 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: X-Tenant: admin Jul 01 03:57:37.056827 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: X-Tenant-Id: e12b5dbdf665489f80381a9cc1ab6bd0 Jul 01 03:57:37.056827 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: X-Tenant-Name: admin Jul 01 03:57:37.056827 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: X-User: admin Jul 01 03:57:37.056827 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: X-User-Domain-Id: default Jul 01 03:57:37.056827 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: X-User-Domain-Name: Default Jul 01 03:57:37.056827 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: X-User-Id: d62406877bb84126838f185cae41e3b4 Jul 01 03:57:37.056827 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: X-User-Name: admin Jul 01 03:57:37.056827 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: method: > Jul 01 03:57:37.056827 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: exception: Flavor 451 could not be found. Jul 01 03:57:37.056827 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: action_args: {'id': '451'} Jul 01 03:57:37.056827 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: {{(pid=104010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 03:57:37.056827 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 03:57:37.058104 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 01 03:57:37.058104 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 01 03:57:37.058104 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 01 03:57:37.058104 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 01 03:57:37.058104 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 01 03:57:37.058104 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 01 03:57:37.058104 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 01 03:57:37.058104 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 01 03:57:37.058104 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 01 03:57:37.058104 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 03:57:37.058104 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 01 03:57:37.058104 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 01 03:57:37.058104 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 01 03:57:37.058104 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: ERROR nova.api.openstack.wsgi Jul 01 03:57:37.058104 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 03:57:37.058104 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: ERROR nova.api.openstack.wsgi Jul 01 03:57:37.058104 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 03:57:37.058104 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 03:57:37.058104 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 03:57:37.060511 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 03:57:37.060511 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 03:57:37.060511 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 03:57:37.060511 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 03:57:37.060511 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 01 03:57:37.060511 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 01 03:57:37.060511 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 01 03:57:37.060511 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: ERROR nova.api.openstack.wsgi Jul 01 03:57:37.060511 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 03:57:37.060511 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: ERROR nova.api.openstack.wsgi Jul 01 03:57:37.060511 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 03:57:37.060511 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 03:57:37.060511 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 03:57:37.060511 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 03:57:37.060511 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 03:57:37.060511 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 01 03:57:37.060511 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: ERROR nova.api.openstack.wsgi Jul 01 03:57:37.060511 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi [None req-24bf5add-5ec9-46fe-826d-6b22c1d8e3c1 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=104010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 03:57:37.061745 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: INFO nova.api.openstack.requestlog [None req-24bf5add-5ec9-46fe-826d-6b22c1d8e3c1 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012722 Jul 01 03:57:37.061745 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: [pid: 104010|app: 0|req: 27/52] 10.222.0.20 () {60 vars in 1193 bytes} [Fri Jul 1 03:57:37 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jul 01 03:57:37.902176 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi [None req-94e60036-143d-40f5-b1ba-6937720d9ce7 admin admin] Calling method '>' {{(pid=104009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 03:57:37.903192 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: INFO nova.api.openstack.requestlog [None req-94e60036-143d-40f5-b1ba-6937720d9ce7 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001469 Jul 01 03:57:37.903665 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: [pid: 104009|app: 0|req: 26/53] 10.222.0.20 () {56 vars in 1074 bytes} [Fri Jul 1 03:57:37 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 03:57:38.093181 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi [None req-f0d8a86a-4b85-4f19-bbc2-51c781beb3d4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=104010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 03:57:38.170314 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: INFO nova.api.openstack.requestlog [None req-f0d8a86a-4b85-4f19-bbc2-51c781beb3d4 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.128809 Jul 01 03:57:38.170864 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: [pid: 104010|app: 0|req: 28/54] 10.222.0.20 () {64 vars in 1235 bytes} [Fri Jul 1 03:57:38 2022] POST /compute/v2.1/flavors => generated 404 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 01 03:57:39.001770 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi [None req-94e60036-143d-40f5-b1ba-6937720d9ce7 admin admin] Calling method '>' {{(pid=104009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 03:57:39.002813 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: INFO nova.api.openstack.requestlog [None req-94e60036-143d-40f5-b1ba-6937720d9ce7 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001466 Jul 01 03:57:39.003254 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: [pid: 104009|app: 0|req: 27/55] 10.222.0.20 () {56 vars in 1074 bytes} [Fri Jul 1 03:57:39 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 03:57:39.194629 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi [None req-15a492b7-3aa0-4f8a-8f67-1469d7ca852f admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=104010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 03:57:39.295491 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: INFO nova.api.openstack.requestlog [None req-15a492b7-3aa0-4f8a-8f67-1469d7ca852f admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.154860 Jul 01 03:57:39.296055 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: [pid: 104010|app: 0|req: 29/56] 10.222.0.20 () {64 vars in 1235 bytes} [Fri Jul 1 03:57:39 2022] POST /compute/v2.1/flavors => generated 405 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 01 03:57:40.134719 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi [None req-94e60036-143d-40f5-b1ba-6937720d9ce7 admin admin] Calling method '>' {{(pid=104009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 03:57:40.135777 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: INFO nova.api.openstack.requestlog [None req-94e60036-143d-40f5-b1ba-6937720d9ce7 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001517 Jul 01 03:57:40.136189 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: [pid: 104009|app: 0|req: 28/57] 10.222.0.20 () {56 vars in 1074 bytes} [Fri Jul 1 03:57:40 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 03:57:40.334118 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi [None req-d0e96ba2-deba-4f32-bc7d-311ff2ac2c95 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=104010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 03:57:40.438642 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: INFO nova.api.openstack.requestlog [None req-d0e96ba2-deba-4f32-bc7d-311ff2ac2c95 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.163776 Jul 01 03:57:40.439123 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: [pid: 104010|app: 0|req: 30/58] 10.222.0.20 () {64 vars in 1235 bytes} [Fri Jul 1 03:57:40 2022] POST /compute/v2.1/flavors => generated 407 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 01 03:57:41.272319 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi [None req-94e60036-143d-40f5-b1ba-6937720d9ce7 admin admin] Calling method '>' {{(pid=104009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 03:57:41.283642 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: INFO nova.api.openstack.requestlog [None req-94e60036-143d-40f5-b1ba-6937720d9ce7 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001504 Jul 01 03:57:41.283642 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: [pid: 104009|app: 0|req: 29/59] 10.222.0.20 () {56 vars in 1074 bytes} [Fri Jul 1 03:57:41 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 03:57:41.464246 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi [None req-9c565a0d-a4de-496d-9b1b-504fda5ccbc8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=104010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 03:57:41.524506 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: INFO nova.api.openstack.requestlog [None req-9c565a0d-a4de-496d-9b1b-504fda5ccbc8 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.111629 Jul 01 03:57:41.525070 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: [pid: 104010|app: 0|req: 31/60] 10.222.0.20 () {64 vars in 1235 bytes} [Fri Jul 1 03:57:41 2022] POST /compute/v2.1/flavors => generated 409 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 01 03:57:42.347880 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi [None req-94e60036-143d-40f5-b1ba-6937720d9ce7 admin admin] Calling method '>' {{(pid=104009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 03:57:42.349115 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: INFO nova.api.openstack.requestlog [None req-94e60036-143d-40f5-b1ba-6937720d9ce7 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001712 Jul 01 03:57:42.349586 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: [pid: 104009|app: 0|req: 30/61] 10.222.0.20 () {56 vars in 1074 bytes} [Fri Jul 1 03:57:42 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 03:57:42.541036 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi [None req-788c5b81-4672-4ce1-a82b-e17ec4edbea2 admin admin] Calling method '>' {{(pid=104010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 03:57:42.560702 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: INFO nova.api.openstack.requestlog [None req-788c5b81-4672-4ce1-a82b-e17ec4edbea2 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.073499 Jul 01 03:57:42.561077 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: [pid: 104010|app: 0|req: 32/62] 10.222.0.20 () {60 vars in 1202 bytes} [Fri Jul 1 03:57:42 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 03:58:29.899866 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi [None req-94e60036-143d-40f5-b1ba-6937720d9ce7 admin admin] Calling method '>' {{(pid=104009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 03:58:29.900912 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: INFO nova.api.openstack.requestlog [None req-94e60036-143d-40f5-b1ba-6937720d9ce7 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001505 Jul 01 03:58:29.901344 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: [pid: 104009|app: 0|req: 31/63] 10.222.0.20 () {54 vars in 930 bytes} [Fri Jul 1 03:58:29 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 03:58:29.912477 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG dbcounter [-] [104010] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=104010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:58:29.962679 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi [None req-3d5aa120-6029-4baa-aa09-e6513d336083 admin admin] Calling method '>' {{(pid=104010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 03:58:29.982267 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: INFO nova.api.openstack.requestlog [None req-3d5aa120-6029-4baa-aa09-e6513d336083 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.074187 Jul 01 03:58:29.982842 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: [pid: 104010|app: 0|req: 33/64] 10.222.0.20 () {60 vars in 1291 bytes} [Fri Jul 1 03:58:29 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 03:58:30.005978 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi [None req-aa59c1ba-d097-4233-8302-b4631d7e978d admin admin] Calling method '>' {{(pid=104009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 03:58:30.009437 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG dbcounter [-] [104009] Writing DB stats nova_api:SELECT=14 {{(pid=104009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:58:30.015256 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: INFO nova.api.openstack.requestlog [None req-aa59c1ba-d097-4233-8302-b4631d7e978d admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012988 Jul 01 03:58:30.023716 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: [pid: 104009|app: 0|req: 32/65] 10.222.0.20 () {60 vars in 1282 bytes} [Fri Jul 1 03:58:30 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 03:58:30.027513 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi [None req-4c5a83a1-fdf9-437a-99c2-09621c38a5df admin admin] Calling method '>' {{(pid=104010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 03:58:30.035251 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: INFO nova.api.openstack.requestlog [None req-4c5a83a1-fdf9-437a-99c2-09621c38a5df admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011463 Jul 01 03:58:30.035779 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: [pid: 104010|app: 0|req: 34/66] 10.222.0.20 () {60 vars in 1285 bytes} [Fri Jul 1 03:58:30 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 03:58:30.047346 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi [None req-b5d3b4c5-f9d6-45e3-ad07-1df6b2c1515d admin admin] Calling method '>' {{(pid=104009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 03:58:30.055212 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: INFO nova.api.openstack.requestlog [None req-b5d3b4c5-f9d6-45e3-ad07-1df6b2c1515d admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011539 Jul 01 03:58:30.055772 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: [pid: 104009|app: 0|req: 33/67] 10.222.0.20 () {60 vars in 1285 bytes} [Fri Jul 1 03:58:30 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 03:58:30.068381 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi [None req-fe677c61-e4c9-4b3a-8659-c2cf4fee392b admin admin] Calling method '>' {{(pid=104010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 03:58:30.076851 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: INFO nova.api.openstack.requestlog [None req-fe677c61-e4c9-4b3a-8659-c2cf4fee392b admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012108 Jul 01 03:58:30.077393 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: [pid: 104010|app: 0|req: 35/68] 10.222.0.20 () {60 vars in 1282 bytes} [Fri Jul 1 03:58:30 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:02:27.902022 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi [None req-b5d3b4c5-f9d6-45e3-ad07-1df6b2c1515d admin admin] Calling method '>' {{(pid=104009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:02:27.903067 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: INFO nova.api.openstack.requestlog [None req-b5d3b4c5-f9d6-45e3-ad07-1df6b2c1515d admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001470 Jul 01 04:02:27.906145 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: [pid: 104009|app: 0|req: 34/69] 10.222.0.20 () {56 vars in 1074 bytes} [Fri Jul 1 04:02:27 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 04:02:28.045741 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG dbcounter [-] [104010] Writing DB stats nova_api:SELECT=6 {{(pid=104010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:02:28.160095 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi [None req-ac812965-3e73-4464-97f6-796d797ef370 admin admin] Calling method '>' {{(pid=104010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:02:28.161268 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 01 04:02:28.161268 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: warnings.warn(msg) Jul 01 04:02:28.162572 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG oslo_concurrency.lockutils [None req-ac812965-3e73-4464-97f6-796d797ef370 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:02:28.163014 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG oslo_concurrency.lockutils [None req-ac812965-3e73-4464-97f6-796d797ef370 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=104010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:02:28.163851 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG oslo_concurrency.lockutils [None req-ac812965-3e73-4464-97f6-796d797ef370 admin admin] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:02:28.164338 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG oslo_concurrency.lockutils [None req-ac812965-3e73-4464-97f6-796d797ef370 admin admin] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=104010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:02:28.199825 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: INFO nova.api.openstack.requestlog [None req-ac812965-3e73-4464-97f6-796d797ef370 admin admin] 10.222.0.20 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.155400 Jul 01 04:02:28.200395 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: [pid: 104010|app: 0|req: 36/70] 10.222.0.20 () {60 vars in 1193 bytes} [Fri Jul 1 04:02:28 2022] GET /compute/v2.1/os-services => generated 791 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 01 04:02:29.026008 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi [None req-b5d3b4c5-f9d6-45e3-ad07-1df6b2c1515d admin admin] Calling method '>' {{(pid=104009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:02:29.027027 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: INFO nova.api.openstack.requestlog [None req-b5d3b4c5-f9d6-45e3-ad07-1df6b2c1515d admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001484 Jul 01 04:02:29.028105 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: [pid: 104009|app: 0|req: 35/71] 10.222.0.20 () {56 vars in 1074 bytes} [Fri Jul 1 04:02:29 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 04:02:29.222337 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi [None req-a6ca86cb-54db-4f8f-ae05-25d8228efef1 admin admin] Calling method '>' {{(pid=104010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:02:29.223721 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 01 04:02:29.223721 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: warnings.warn(msg) Jul 01 04:02:29.224919 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG oslo_concurrency.lockutils [None req-a6ca86cb-54db-4f8f-ae05-25d8228efef1 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:02:29.225362 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG oslo_concurrency.lockutils [None req-a6ca86cb-54db-4f8f-ae05-25d8228efef1 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=104010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:02:29.226227 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG oslo_concurrency.lockutils [None req-a6ca86cb-54db-4f8f-ae05-25d8228efef1 admin admin] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:02:29.226662 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG oslo_concurrency.lockutils [None req-a6ca86cb-54db-4f8f-ae05-25d8228efef1 admin admin] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=104010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:02:29.245909 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: INFO nova.api.openstack.requestlog [None req-a6ca86cb-54db-4f8f-ae05-25d8228efef1 admin admin] 10.222.0.20 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.078429 Jul 01 04:02:29.246935 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: [pid: 104010|app: 0|req: 37/72] 10.222.0.20 () {60 vars in 1193 bytes} [Fri Jul 1 04:02:29 2022] GET /compute/v2.1/os-services => generated 791 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 01 04:02:40.478688 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi [None req-b5d3b4c5-f9d6-45e3-ad07-1df6b2c1515d admin admin] Calling method '>' {{(pid=104009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:02:40.479739 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: INFO nova.api.openstack.requestlog [None req-b5d3b4c5-f9d6-45e3-ad07-1df6b2c1515d admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001464 Jul 01 04:02:40.480142 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: [pid: 104009|app: 0|req: 36/73] 10.222.0.20 () {56 vars in 1074 bytes} [Fri Jul 1 04:02:40 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 04:02:40.623877 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG dbcounter [-] [104010] Writing DB stats nova_cell0:SELECT=4 {{(pid=104010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:02:40.625178 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG dbcounter [-] [104010] Writing DB stats nova_cell1:SELECT=4 {{(pid=104010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:02:40.625797 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG dbcounter [-] [104010] Writing DB stats nova_api:SELECT=8 {{(pid=104010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:02:40.676179 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi [None req-bd4b0191-ea21-4171-8a73-85b95974e7a8 admin admin] Calling method '>' {{(pid=104010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:02:40.677366 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 01 04:02:40.677366 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: warnings.warn(msg) Jul 01 04:02:40.678565 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG oslo_concurrency.lockutils [None req-bd4b0191-ea21-4171-8a73-85b95974e7a8 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:02:40.679008 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG oslo_concurrency.lockutils [None req-bd4b0191-ea21-4171-8a73-85b95974e7a8 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=104010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:02:40.679825 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG oslo_concurrency.lockutils [None req-bd4b0191-ea21-4171-8a73-85b95974e7a8 admin admin] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:02:40.680298 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG oslo_concurrency.lockutils [None req-bd4b0191-ea21-4171-8a73-85b95974e7a8 admin admin] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=104010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:02:40.707716 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: INFO nova.api.openstack.requestlog [None req-bd4b0191-ea21-4171-8a73-85b95974e7a8 admin admin] 10.222.0.20 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.088134 Jul 01 04:02:40.708213 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: [pid: 104010|app: 0|req: 38/74] 10.222.0.20 () {60 vars in 1193 bytes} [Fri Jul 1 04:02:40 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 04:02:41.543917 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: DEBUG nova.api.openstack.wsgi [None req-b5d3b4c5-f9d6-45e3-ad07-1df6b2c1515d admin admin] Calling method '>' {{(pid=104009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:02:41.544939 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: INFO nova.api.openstack.requestlog [None req-b5d3b4c5-f9d6-45e3-ad07-1df6b2c1515d admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001470 Jul 01 04:02:41.545331 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: [pid: 104009|app: 0|req: 37/75] 10.222.0.20 () {56 vars in 1074 bytes} [Fri Jul 1 04:02:41 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 04:02:41.738835 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG nova.api.openstack.wsgi [None req-3f7cfbd1-039a-4332-9648-83c1fc8b631a admin admin] Calling method '>' {{(pid=104010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:02:41.740037 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 01 04:02:41.740037 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: warnings.warn(msg) Jul 01 04:02:41.741332 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG oslo_concurrency.lockutils [None req-3f7cfbd1-039a-4332-9648-83c1fc8b631a admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:02:41.741806 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG oslo_concurrency.lockutils [None req-3f7cfbd1-039a-4332-9648-83c1fc8b631a admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=104010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:02:41.742600 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG oslo_concurrency.lockutils [None req-3f7cfbd1-039a-4332-9648-83c1fc8b631a admin admin] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:02:41.743034 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: DEBUG oslo_concurrency.lockutils [None req-3f7cfbd1-039a-4332-9648-83c1fc8b631a admin admin] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=104010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:02:41.765642 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: INFO nova.api.openstack.requestlog [None req-3f7cfbd1-039a-4332-9648-83c1fc8b631a admin admin] 10.222.0.20 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.080071 Jul 01 04:02:41.766134 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: [pid: 104010|app: 0|req: 39/76] 10.222.0.20 () {60 vars in 1193 bytes} [Fri Jul 1 04:02:41 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 04:03:37.653817 dv-cinder-846842-8-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jul 01 04:03:37.654603 dv-cinder-846842-8-iscsi devstack@n-api.service[103970]: Fri Jul 1 04:03:37 2022 - graceful shutdown triggered... Jul 01 04:03:37.655093 dv-cinder-846842-8-iscsi devstack@n-api.service[104009]: Gracefully killing worker 1 (pid: 104009)... Jul 01 04:03:37.655809 dv-cinder-846842-8-iscsi devstack@n-api.service[104010]: Gracefully killing worker 2 (pid: 104010)... Jul 01 04:03:38.655758 dv-cinder-846842-8-iscsi devstack@n-api.service[103970]: worker 1 buried after 1 seconds Jul 01 04:03:38.656331 dv-cinder-846842-8-iscsi devstack@n-api.service[103970]: worker 2 buried after 1 seconds Jul 01 04:03:38.656331 dv-cinder-846842-8-iscsi devstack@n-api.service[103970]: goodbye to uWSGI. Jul 01 04:03:38.657402 dv-cinder-846842-8-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jul 01 04:03:38.657956 dv-cinder-846842-8-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jul 01 04:03:38.661375 dv-cinder-846842-8-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jul 01 04:03:38.670506 dv-cinder-846842-8-iscsi devstack@n-api.service[118699]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 01 04:03:38.672611 dv-cinder-846842-8-iscsi devstack@n-api.service[118699]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Jul 1 04:03:38 2022] *** Jul 01 04:03:38.672611 dv-cinder-846842-8-iscsi devstack@n-api.service[118699]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 01 04:03:38.672611 dv-cinder-846842-8-iscsi devstack@n-api.service[118699]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 01 04:03:38.672611 dv-cinder-846842-8-iscsi devstack@n-api.service[118699]: nodename: dv-cinder-846842-8-iscsi Jul 01 04:03:38.672611 dv-cinder-846842-8-iscsi devstack@n-api.service[118699]: machine: x86_64 Jul 01 04:03:38.672611 dv-cinder-846842-8-iscsi devstack@n-api.service[118699]: clock source: unix Jul 01 04:03:38.672611 dv-cinder-846842-8-iscsi devstack@n-api.service[118699]: pcre jit disabled Jul 01 04:03:38.672611 dv-cinder-846842-8-iscsi devstack@n-api.service[118699]: detected number of CPU cores: 4 Jul 01 04:03:38.672611 dv-cinder-846842-8-iscsi devstack@n-api.service[118699]: current working directory: / Jul 01 04:03:38.672611 dv-cinder-846842-8-iscsi devstack@n-api.service[118699]: detected binary path: /usr/bin/uwsgi-core Jul 01 04:03:38.672611 dv-cinder-846842-8-iscsi devstack@n-api.service[118699]: your processes number limit is 47680 Jul 01 04:03:38.673314 dv-cinder-846842-8-iscsi devstack@n-api.service[118699]: your memory page size is 4096 bytes Jul 01 04:03:38.673314 dv-cinder-846842-8-iscsi devstack@n-api.service[118699]: detected max file descriptor number: 2048 Jul 01 04:03:38.673314 dv-cinder-846842-8-iscsi devstack@n-api.service[118699]: lock engine: pthread robust mutexes Jul 01 04:03:38.673314 dv-cinder-846842-8-iscsi devstack@n-api.service[118699]: thunder lock: enabled Jul 01 04:03:38.673314 dv-cinder-846842-8-iscsi devstack@n-api.service[118699]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 01 04:03:38.673314 dv-cinder-846842-8-iscsi devstack@n-api.service[118699]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jul 01 04:03:38.717999 dv-cinder-846842-8-iscsi devstack@n-api.service[118699]: Python main interpreter initialized at 0x559a8fdc39c0 Jul 01 04:03:38.717999 dv-cinder-846842-8-iscsi devstack@n-api.service[118699]: python threads support enabled Jul 01 04:03:38.717999 dv-cinder-846842-8-iscsi devstack@n-api.service[118699]: your server socket listen backlog is limited to 100 connections Jul 01 04:03:38.717999 dv-cinder-846842-8-iscsi devstack@n-api.service[118699]: your mercy for graceful operations on workers is 90 seconds Jul 01 04:03:38.718425 dv-cinder-846842-8-iscsi devstack@n-api.service[118699]: mapped 403077 bytes (393 KB) for 2 cores Jul 01 04:03:38.718425 dv-cinder-846842-8-iscsi devstack@n-api.service[118699]: *** Operational MODE: preforking *** Jul 01 04:03:38.718730 dv-cinder-846842-8-iscsi devstack@n-api.service[118699]: *** uWSGI is running in multiple interpreter mode *** Jul 01 04:03:38.718730 dv-cinder-846842-8-iscsi devstack@n-api.service[118699]: spawned uWSGI master process (pid: 118699) Jul 01 04:03:38.718931 dv-cinder-846842-8-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jul 01 04:03:38.723312 dv-cinder-846842-8-iscsi devstack@n-api.service[118699]: spawned uWSGI worker 1 (pid: 118711, cores: 1) Jul 01 04:03:38.723312 dv-cinder-846842-8-iscsi devstack@n-api.service[118699]: spawned uWSGI worker 2 (pid: 118712, cores: 1) Jul 01 04:03:38.723312 dv-cinder-846842-8-iscsi devstack@n-api.service[118699]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 01 04:03:39.381238 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 01 04:03:39.384929 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 01 04:03:40.592845 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 01 04:03:40.592845 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: from cryptography.utils import int_from_bytes Jul 01 04:03:40.593486 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 01 04:03:40.593486 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: from cryptography.utils import int_from_bytes Jul 01 04:03:40.602651 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 01 04:03:40.602651 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: from cryptography.utils import int_from_bytes Jul 01 04:03:40.603339 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 01 04:03:40.603339 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: from cryptography.utils import int_from_bytes Jul 01 04:03:42.991601 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 01 04:03:42.992152 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 01 04:03:42.992422 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 01 04:03:42.992663 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 01 04:03:42.992920 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 01 04:03:42.993314 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 04:03:42.993642 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 04:03:42.993965 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 04:03:42.994289 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 04:03:42.994621 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 04:03:42.994933 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 04:03:42.995273 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 04:03:42.995671 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 04:03:42.995930 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 04:03:42.996191 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 04:03:42.996507 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 04:03:42.996833 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-846842-8-iscsi {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 04:03:42.997157 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 04:03:42.997467 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 04:03:42.997778 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 04:03:42.998099 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 04:03:42.998404 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 04:03:42.998727 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 04:03:42.999033 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 04:03:42.999645 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 01 04:03:43.000086 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 04:03:43.000190 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 04:03:43.000485 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 04:03:43.000730 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 01 04:03:43.000842 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 04:03:43.001128 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 04:03:43.001447 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 04:03:43.001760 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 04:03:43.001977 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 01 04:03:43.002108 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 04:03:43.002360 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 01 04:03:43.002485 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 04:03:43.002685 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 01 04:03:43.002801 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 04:03:43.002994 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 04:03:43.003101 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 04:03:43.003386 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 04:03:43.004029 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-846842-8-iscsi {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 04:03:43.004246 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 04:03:43.004364 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 04:03:43.004567 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 04:03:43.004678 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 04:03:43.004878 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 04:03:43.005003 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 04:03:43.005220 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 04:03:43.005341 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 04:03:43.005556 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 04:03:43.005681 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 04:03:43.005881 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 04:03:43.006101 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 04:03:43.006343 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 04:03:43.006555 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 04:03:43.006555 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 04:03:43.007028 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 04:03:43.007257 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 04:03:43.007468 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 04:03:43.007692 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-846842-8-iscsi {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 04:03:43.007908 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 04:03:43.007908 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 04:03:43.008331 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 04:03:43.008519 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 04:03:43.008679 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 04:03:43.008867 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 04:03:43.009019 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 04:03:43.009202 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 04:03:43.009362 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 04:03:43.009515 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 04:03:43.009667 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 04:03:43.009850 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 04:03:43.009999 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 04:03:43.010155 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 04:03:43.010299 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 04:03:43.010450 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 04:03:43.010601 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 04:03:43.010788 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 04:03:43.010788 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 04:03:43.011074 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 04:03:43.011348 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 04:03:43.011501 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 04:03:43.011681 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 04:03:43.011861 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 04:03:43.012016 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 04:03:43.012188 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 04:03:43.012347 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 04:03:43.012494 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 04:03:43.012655 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 04:03:43.012813 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 04:03:43.013066 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 04:03:43.013223 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 04:03:43.013378 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 04:03:43.013529 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 04:03:43.013673 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 04:03:43.013826 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 04:03:43.014492 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 04:03:43.014656 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 04:03:43.014810 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 04:03:43.014810 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 04:03:43.015096 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-846842-8-iscsi {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 04:03:43.015271 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 04:03:43.015423 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 04:03:43.015580 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 04:03:43.015724 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 04:03:43.015878 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 04:03:43.016031 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 04:03:43.016190 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 04:03:43.016337 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 04:03:43.016489 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 04:03:43.016639 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 04:03:43.016789 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 04:03:43.016958 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 04:03:43.017110 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 04:03:43.017253 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 04:03:43.017404 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 04:03:43.017554 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 04:03:43.017698 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 04:03:43.017850 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 04:03:43.018002 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 04:03:43.018157 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 04:03:43.018301 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.20 {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 04:03:43.018451 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 04:03:43.018595 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.20 {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 04:03:43.018595 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 04:03:43.018889 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 04:03:43.018889 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 04:03:43.019743 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 04:03:43.019908 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 04:03:43.020067 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 04:03:43.020067 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 04:03:43.020347 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 04:03:43.020498 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 04:03:43.020648 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 04:03:43.020802 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 04:03:43.020953 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 04:03:43.021104 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 04:03:43.021256 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 04:03:43.021256 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 04:03:43.021551 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 04:03:43.021701 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 04:03:43.021861 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 04:03:43.022017 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 04:03:43.022169 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 04:03:43.022320 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 04:03:43.022470 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 04:03:43.022621 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 04:03:43.022778 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 04:03:43.022932 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 04:03:43.023087 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 04:03:43.023280 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 04:03:43.023434 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 04:03:43.023790 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 04:03:43.023944 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 04:03:43.024107 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 04:03:43.024753 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 04:03:43.024907 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 04:03:43.025053 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 04:03:43.025210 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 04:03:43.025363 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 04:03:43.025515 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 04:03:43.025666 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 04:03:43.025831 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 04:03:43.025995 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 04:03:43.026147 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 04:03:43.026310 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 04:03:43.026455 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 04:03:43.026606 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 04:03:43.026757 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 04:03:43.026913 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 04:03:43.027068 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 04:03:43.027273 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 04:03:43.027439 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 04:03:43.027592 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 04:03:43.027736 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 04:03:43.027903 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 04:03:43.028055 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 04:03:43.028206 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 04:03:43.028206 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 04:03:43.028485 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 04:03:43.028628 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 04:03:43.028781 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 04:03:43.028932 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 04:03:43.029083 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 04:03:43.029237 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 04:03:43.029396 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.20 {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 04:03:43.029541 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 04:03:43.029709 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.20 {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 04:03:43.029862 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 04:03:43.030017 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 04:03:43.030161 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 04:03:43.030303 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 04:03:43.030462 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 04:03:43.030606 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 04:03:43.030760 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 04:03:43.030918 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 04:03:43.031076 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 04:03:43.031247 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 04:03:43.031398 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 04:03:43.031541 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 04:03:43.031695 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 04:03:43.031856 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 04:03:43.032009 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 04:03:43.032153 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 04:03:43.032302 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 04:03:43.032453 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 04:03:43.032596 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 04:03:43.032754 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 04:03:43.032898 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 04:03:43.033049 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 04:03:43.033193 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 04:03:43.033344 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 04:03:43.033496 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 04:03:43.033664 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 04:03:43.033853 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 04:03:43.034002 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 04:03:43.034153 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 04:03:43.034315 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 04:03:43.034989 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 04:03:43.035136 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 04:03:43.035340 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 04:03:43.035490 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 04:03:43.035646 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 04:03:43.035791 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 04:03:43.035945 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 04:03:43.036098 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 04:03:43.036271 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 04:03:43.036425 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 04:03:43.036569 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 04:03:43.036722 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 04:03:43.036882 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 04:03:43.037026 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 04:03:43.037170 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 04:03:43.037321 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 04:03:43.037465 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 04:03:43.037608 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 04:03:43.037765 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 04:03:43.037917 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 04:03:43.038063 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 04:03:43.038219 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 04:03:43.038370 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 04:03:43.038514 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 04:03:43.038666 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 04:03:43.038810 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 04:03:43.038969 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 04:03:43.039114 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 04:03:43.039285 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 04:03:43.039449 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 04:03:43.039602 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 04:03:43.039755 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 04:03:43.039900 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.040061 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 04:03:43.040216 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.040376 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 04:03:43.040521 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.040671 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 04:03:43.040823 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.040980 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 04:03:43.041125 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.041278 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 04:03:43.041422 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.041573 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 04:03:43.041736 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.041882 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 04:03:43.042036 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.042036 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.042323 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 04:03:43.042323 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 04:03:43.050597 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.050806 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 04:03:43.050976 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.050976 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.051296 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 04:03:43.051464 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.051615 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 04:03:43.051768 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.051932 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 04:03:43.052085 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.052239 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 04:03:43.052392 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.052536 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 04:03:43.052688 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.052832 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 04:03:43.052974 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.053117 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 04:03:43.053270 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.053431 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 04:03:43.053583 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.053736 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 04:03:43.053890 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.054048 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 04:03:43.054206 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.054358 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 04:03:43.054510 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.054654 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 04:03:43.054807 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.054964 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 04:03:43.055108 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.055279 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 04:03:43.055439 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.055590 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 04:03:43.055742 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.055910 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 04:03:43.056630 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.056796 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 04:03:43.056969 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.057202 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 04:03:43.057354 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.057505 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 04:03:43.057649 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.057802 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 04:03:43.057957 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.058118 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 04:03:43.058281 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.058433 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 04:03:43.058674 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.058825 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.058986 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.059132 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.059318 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.059468 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.059612 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.059770 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.059929 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.060074 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.060250 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.060250 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.061231 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.061385 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.061539 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.061691 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.061842 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.061987 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.062133 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.062284 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.062437 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.062582 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.062732 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.062887 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.063037 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.063196 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.063380 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.063527 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.063671 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.063814 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.063956 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.064112 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.064257 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.064408 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.064559 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.064704 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.064856 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.065013 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.065166 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.065317 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.065461 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.065604 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.065747 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.065899 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.066559 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.066720 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.066865 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.067008 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.067182 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.067449 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.067449 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.067737 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.067889 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.068044 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.068202 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.068348 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.068491 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.068653 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.068894 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.069058 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.069218 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.069363 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.069526 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.069670 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.069814 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.069964 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.070122 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.070274 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.070444 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.070973 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.071120 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.071299 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.071459 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.071604 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.071765 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.071909 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.072059 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.072215 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.072360 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.072505 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.072655 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.072800 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.072945 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.073097 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.073249 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.073393 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.073544 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.073643 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.073732 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.073830 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.073924 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.074016 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.074107 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.074190 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.074286 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.074378 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.074469 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.074553 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.074642 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.074726 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.074818 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.074908 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.074993 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.075075 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.075157 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.075263 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.075363 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.075449 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.075540 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.075626 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.075719 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.075810 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.075907 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.075992 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.076075 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.076157 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.076247 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.076417 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.076507 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.076589 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.076673 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.076673 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.076840 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.076932 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.077024 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.077108 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.077198 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.077288 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.077373 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.077488 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.077576 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.077661 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.077750 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.077842 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.077935 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.078033 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.078125 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.078215 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.078300 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.078383 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.078475 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.078568 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.078660 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.078745 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.078836 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.078942 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.079035 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.079128 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.079234 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.079333 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.079417 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.079500 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.079596 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.079691 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.079781 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.079865 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.079954 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.080038 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.080129 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.080221 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.080305 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.080387 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.080468 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.080563 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.080935 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.081033 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.081116 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.081210 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.081295 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.081391 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.081482 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.081572 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.081729 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.082326 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.082412 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.082507 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.082592 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.082681 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.082770 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.082861 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.082944 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.083035 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.083120 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.083120 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.083358 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.083358 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.083521 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.083521 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.083694 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.083694 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.083848 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.083939 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.084035 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.084126 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.084215 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.084299 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.084381 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.084470 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.084562 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.084654 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.084738 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.084827 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.084910 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.084999 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.085116 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.085264 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.085394 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.085542 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.085689 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.085837 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.085997 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.086142 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.086287 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.086432 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.086573 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.086723 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.086879 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.087035 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.087185 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.087361 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.087501 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.087657 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.087798 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.087935 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.088074 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.088232 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.088388 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.088547 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.088698 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.088848 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.089000 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.089136 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.089262 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.089430 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.089579 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.089733 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.089889 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.090043 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.090204 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.090358 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.090507 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.090651 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.090833 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.091282 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.091398 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.091488 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.091571 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.091654 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.091736 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.091818 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.091818 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.092000 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.092139 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.092253 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.092340 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.092443 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.092549 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.092623 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.092693 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.092769 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.092847 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.092934 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.093066 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.093166 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.093259 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.093350 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.093434 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.093531 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.093625 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.093709 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.093805 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.093907 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.093986 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.094066 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.094153 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.094243 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.094326 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.094417 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.094503 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.094594 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.094679 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.094768 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.094852 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.094941 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.095031 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.095127 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.095235 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.095322 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.095417 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.095502 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.095593 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.095677 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.095747 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.095823 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.095901 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.095977 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.096060 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.096139 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.096139 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.096274 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.096274 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.096413 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.096567 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.096640 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.096717 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.096787 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.096856 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.096925 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.097002 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.097822 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.097987 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.098139 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.098289 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.098289 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.098591 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.098688 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.098780 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.098872 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.098956 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.098956 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.103254 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.103402 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.103507 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.103507 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.103676 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.103777 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.103777 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.103932 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.104022 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.104105 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.104193 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.104193 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.104360 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.104449 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.104532 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.104621 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.104713 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.104796 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.104878 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.104967 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.105058 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.105147 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.105238 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.105328 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.105428 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.105512 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.105603 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.105693 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.105784 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.105877 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.105967 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.106063 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.106153 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.106252 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.106360 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.106453 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.106536 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.106626 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.106710 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.106805 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.106896 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.106986 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.107069 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.107162 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.107264 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.107350 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.107435 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.107517 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.107607 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.107702 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.107787 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.107868 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.107956 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.108062 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.108210 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.108385 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.108528 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.108709 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.108863 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.109044 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.109184 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.109368 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.109500 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.109690 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.109815 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.110013 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.110113 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.110329 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.110469 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.110650 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.110785 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.110977 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.111138 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.111597 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.111711 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.111949 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.112088 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.112282 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.113359 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.113485 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.113595 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.113723 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.114000 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.114179 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.114351 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.114491 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.114640 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.114640 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.114906 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.115063 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.115314 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.115424 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.115513 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.115606 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.115690 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.115780 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.115863 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.116061 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.116161 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.116382 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.116473 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.116698 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.116779 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.117007 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.117100 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.117321 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.117428 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.117628 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.117725 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.117941 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.118278 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.118595 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.118703 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.118792 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.118871 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.118951 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.119040 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.119164 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.119274 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.119507 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.119595 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.119819 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.119912 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.120217 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.120520 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.120520 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.120725 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.120821 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.120914 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.121047 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.121146 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.121390 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.121536 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.121708 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.121818 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.122063 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.122370 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.122586 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.122771 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.122771 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.123044 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.123184 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.123343 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.123430 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.123526 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.123658 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.123749 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.123974 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.124065 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.124292 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.124397 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.124607 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.124705 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.124919 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.125018 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.125234 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.125326 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.125555 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.125655 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.125883 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.125989 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.126186 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.126283 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.126505 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.126602 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.126814 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.126903 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.127129 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.127250 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.127466 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.127558 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.127785 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.127884 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.128093 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.128184 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.128405 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.129102 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.129271 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.129373 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.129586 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.129673 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.129901 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.130019 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.130213 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.130313 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.130534 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.130630 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.130848 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.130937 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.131160 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.131308 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.131526 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.131639 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.131830 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.131933 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.132155 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.132268 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.132471 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.132601 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.132786 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.132919 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.133102 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.133242 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.133424 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.133571 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.133751 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.133898 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.134067 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.134219 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.134399 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.134545 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.134723 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.134856 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.135026 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.135181 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.135447 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.135563 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.135706 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.135832 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.136022 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.136144 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.136337 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.136458 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.136709 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.136815 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.136991 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.137084 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.137368 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.137474 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.137639 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.137819 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.137959 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.138097 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.138265 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.138402 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.138583 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.138734 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.138885 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.139025 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.139207 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.139323 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.139546 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.139653 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.139862 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.139953 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.140178 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.140285 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.140491 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.140595 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.140807 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.140898 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.141134 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.141224 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.141453 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.141566 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.141770 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.141893 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.142085 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.142196 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.142397 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.142497 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.142751 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.142851 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.143069 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.143168 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.143437 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.143530 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.143766 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.143868 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.144092 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.144187 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.144420 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.144519 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.144735 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.144826 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.145053 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.145157 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.145362 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.145453 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.145709 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.145799 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.146036 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.146141 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.146359 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.146457 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.146685 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.146777 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.147000 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.147104 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.147340 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.147446 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.147661 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.147758 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.147985 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.148091 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.148297 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.148395 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.148627 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.148716 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.148961 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.149062 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.149298 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.149396 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.149615 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.149710 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.149930 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.150021 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.150243 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.150343 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.150559 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.150656 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.150879 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.150978 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.151191 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.151306 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.151528 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.151619 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.151865 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.152017 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.152248 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.152413 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.152564 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.152728 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.152831 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.152923 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.153117 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.153289 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.153439 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.153621 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.153767 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.153932 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.154081 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.154356 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.154449 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.154675 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.154773 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.154992 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.155090 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.155359 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.155452 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.155675 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.155766 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.155999 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.156089 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.156308 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.156411 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.156628 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.156753 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.156946 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.157079 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.157275 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.157402 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.157605 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.157718 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.157924 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.158042 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.158247 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.158349 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.158558 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.158663 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.158885 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.158978 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.159213 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.159345 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.159554 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.159759 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.159911 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.160090 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.160337 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.160470 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.160667 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.160759 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.160985 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.161077 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.161315 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.161408 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.161635 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.161725 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.161972 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.162068 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.162309 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.162420 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.162600 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.162700 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.162916 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.163017 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.163270 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.163365 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.163592 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.163683 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.163915 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.164014 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.164234 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.164333 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.164553 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.164645 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.164872 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.164972 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.165183 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.165371 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.165496 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.165698 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.165828 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.166020 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.166140 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.166353 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.166453 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.166689 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.166783 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.167025 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.167126 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.167369 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.167464 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.167698 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.167791 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.168022 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.168113 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.168347 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.168437 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.168660 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.168751 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.168970 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.169061 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.169281 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.169380 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.169604 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.169729 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.169928 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.170019 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.170258 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.170398 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.170580 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.170671 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.170911 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.171002 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.171242 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.171348 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.171587 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.171678 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.171923 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.172013 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.172312 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.172437 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.172650 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.172753 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.172965 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.173057 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.173282 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.173376 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.173591 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.173682 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.173909 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.174008 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.174221 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.174316 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.174533 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.174623 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.174843 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.174942 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.175157 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.175269 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.176037 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.176133 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.176354 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.176447 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.176666 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.176766 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.176983 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.177084 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.177292 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.177392 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.177620 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.177710 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.177934 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.178024 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.178244 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.178349 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.178555 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.178646 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.178864 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.178961 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.179205 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.179370 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.179541 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.179641 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.179870 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.179968 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.180188 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.180287 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.180503 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.180595 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.180817 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.180916 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.181142 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.181240 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.181474 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.181578 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.181800 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.181891 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.182188 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.182292 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.182466 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.182558 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.182792 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.182901 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.183111 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.183210 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.183459 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.183562 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.183788 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.183880 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.184105 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.184197 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.184425 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.184517 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.184747 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.184847 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.185060 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.185153 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.185381 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.185627 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.185725 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.186228 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.186330 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.186550 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.186641 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.186867 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.186957 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.187179 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.187300 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.187525 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.187623 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.187837 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.187927 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.188152 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.188244 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.188469 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.188560 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.188789 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.188894 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.189106 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.189197 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.189421 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.189512 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.189734 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.189835 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.190049 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.190152 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.190398 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.190488 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.190713 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.190827 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.191074 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.191689 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.191914 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.192006 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.192298 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.192404 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.192590 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.192682 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.192908 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.192999 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.193222 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.193322 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.193545 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.193636 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.193865 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.193956 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.194187 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.194290 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.194508 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.194601 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.194824 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.194925 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.195145 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.195273 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.195489 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.195593 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.195807 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.195907 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.196121 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.196221 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.196440 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.196538 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.196759 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.196864 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.197092 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.197324 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.197424 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.197672 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.197776 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.198001 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.198093 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.198331 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.198431 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.198659 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.198768 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.198987 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.199180 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.199358 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.199527 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.199691 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.199868 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.200019 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.200201 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.200389 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.200533 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.200675 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.200861 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.201020 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.201187 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.201354 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.201520 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.201695 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.201835 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.202045 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.202137 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.202374 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.202514 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.202808 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.202932 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.203050 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.203134 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.203367 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.203473 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.203700 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.203801 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.204015 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.204115 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.204343 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.204450 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.204660 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.204750 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.204985 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.205210 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.205299 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.205574 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.205685 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.205901 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.206003 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.206234 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.206334 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.206751 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.206894 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.206993 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.207088 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.207297 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.207402 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.207556 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.207675 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.207871 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.207967 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.208185 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.208301 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.208508 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.208627 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.208825 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.208929 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.209134 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.209240 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.209442 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.209534 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.209760 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.209856 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.210077 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.210317 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.210420 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.210644 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.210738 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.210989 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.211093 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.211348 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.211450 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.211658 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.211758 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.211971 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.212079 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.212283 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.212376 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.212604 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.212714 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.212914 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.213032 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.213225 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.213329 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.213534 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.213633 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.213840 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.213934 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.214159 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.214267 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.214465 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.214565 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.214780 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.214882 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.215088 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.215301 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.215464 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.215556 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.215791 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.215893 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.216103 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.216335 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.216468 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.216696 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.216796 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.217024 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.217125 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.217364 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.217457 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.217696 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.217795 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.218014 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.218112 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.218329 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.218427 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.218644 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.218743 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.218961 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.219063 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.219299 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.219394 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.219629 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.219724 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.219953 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.220175 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.220303 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.220513 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.220613 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.220841 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.220939 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.221266 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.221411 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.221514 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.221601 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.221799 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.221891 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.222109 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.222223 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.222445 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.222590 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.222786 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.222877 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.223083 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.223177 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.223399 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.223496 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.223723 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.223815 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.224038 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.224131 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.224353 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.224444 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.224665 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.224765 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.224978 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.225082 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.225295 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.225388 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.225608 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.225707 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.225920 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.226021 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.226231 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.226322 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.226544 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.226635 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.226853 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.226956 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.227173 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.227296 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.227548 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.227640 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.227878 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.227971 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.228192 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.228289 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.228506 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.228597 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.228827 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.228954 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.229143 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.229237 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.229459 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.229549 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.229774 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.229874 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.230089 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.230180 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.230410 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.230500 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.230743 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.230837 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.231059 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.231404 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.231542 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.231653 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.231912 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.232013 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.232238 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.232330 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.232567 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.232704 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.232900 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.233012 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.233229 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.233323 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.233534 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.233643 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.233863 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.233956 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.234182 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.234281 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.234505 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.234597 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.234820 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.234911 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.235143 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.235249 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.235530 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.235622 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.235865 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.235956 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.236187 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.236278 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.236511 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.236646 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.236975 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.237106 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.237221 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.237343 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.237464 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.237583 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.237741 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.238380 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.238583 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.238688 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.238894 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.238986 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.239203 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.239351 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.239540 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.239645 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.239850 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.239942 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.240159 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.240253 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.240465 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.240607 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.240772 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.240863 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.241084 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.241176 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.241419 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.241566 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.241775 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.241875 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.242032 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.242132 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.242356 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.242451 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.242665 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.242792 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.242973 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.243122 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.243314 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.243571 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.243676 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.243897 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.244002 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.244216 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.244329 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.244524 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.244617 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.244830 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.244929 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.245167 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.245267 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.245499 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.245590 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.245818 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.245924 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.246148 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.246240 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.246463 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.246562 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.246795 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.246922 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.247107 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.247209 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.247458 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.247551 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.247786 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.247892 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.248109 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.248201 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.248425 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.248535 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.248738 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.249001 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.249130 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.249222 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.249370 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.249469 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.249683 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.249854 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.249993 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.250093 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.250304 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.250396 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.250622 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.250794 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.250941 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.251081 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.251251 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.251348 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.251550 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.251653 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.251862 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.251970 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.252180 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.252280 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.252491 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.252592 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.252805 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.252918 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.253120 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.253223 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.253433 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.253592 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.254288 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.254391 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.254606 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.254724 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.254927 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.255039 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.255248 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.255350 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.255574 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.255686 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.255887 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.255989 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.256203 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.256312 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.256515 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.256625 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.256860 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.256977 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.257176 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.257284 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.257505 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.257614 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.257836 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.257948 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.258156 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.258265 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.258490 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.258796 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.258905 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.258995 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.259134 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.259257 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.259491 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.259596 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.259817 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.259909 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.260123 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.260215 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.260370 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 01 04:03:43.260464 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.260777 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.261098 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.261421 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.261741 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.262064 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.262385 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.262725 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.263065 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.263409 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.263749 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.264079 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.264410 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.264743 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.265065 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.265407 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.265728 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.266049 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.266375 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.266696 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.267018 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.267368 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.267696 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.268032 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.268366 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.268686 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.269021 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.269390 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.269749 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.270090 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.270428 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.270767 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.271090 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.271449 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.271769 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 04:03:43.272021 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 01 04:03:43.323078 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO dbcounter [None req-d3a0dbc2-153a-4d35-ada7-fe8409864854 None None] Registered counter for database nova_api Jul 01 04:03:43.335158 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO dbcounter [None req-31cea34f-f37b-459e-b306-84ed1548acf8 None None] Registered counter for database nova_api Jul 01 04:03:43.344049 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_db.sqlalchemy.engines [None req-d3a0dbc2-153a-4d35-ada7-fe8409864854 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118711) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 01 04:03:43.350856 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG dbcounter [-] [118711] Writer thread running {{(pid=118711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 01 04:03:43.355792 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_db.sqlalchemy.engines [None req-31cea34f-f37b-459e-b306-84ed1548acf8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118712) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 01 04:03:43.362740 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG dbcounter [-] [118712] Writer thread running {{(pid=118712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 01 04:03:43.407810 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.context [None req-d3a0dbc2-153a-4d35-ada7-fe8409864854 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),645b6dde-2c23-4766-a50b-4919c2bf5c2f(cell1) {{(pid=118711) load_cells /opt/stack/nova/nova/context.py:464}} Jul 01 04:03:43.412023 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-d3a0dbc2-153a-4d35-ada7-fe8409864854 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:03:43.413635 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-d3a0dbc2-153a-4d35-ada7-fe8409864854 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:03:43.414448 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-d3a0dbc2-153a-4d35-ada7-fe8409864854 None None] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:03:43.416471 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-d3a0dbc2-153a-4d35-ada7-fe8409864854 None None] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:03:43.418510 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO dbcounter [None req-d3a0dbc2-153a-4d35-ada7-fe8409864854 None None] Registered counter for database nova_cell0 Jul 01 04:03:43.420058 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.context [None req-31cea34f-f37b-459e-b306-84ed1548acf8 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),645b6dde-2c23-4766-a50b-4919c2bf5c2f(cell1) {{(pid=118712) load_cells /opt/stack/nova/nova/context.py:464}} Jul 01 04:03:43.422715 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO dbcounter [None req-d3a0dbc2-153a-4d35-ada7-fe8409864854 None None] Registered counter for database nova_cell1 Jul 01 04:03:43.424226 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-31cea34f-f37b-459e-b306-84ed1548acf8 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:03:43.426397 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-31cea34f-f37b-459e-b306-84ed1548acf8 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:03:43.427429 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-31cea34f-f37b-459e-b306-84ed1548acf8 None None] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:03:43.429288 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-31cea34f-f37b-459e-b306-84ed1548acf8 None None] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:03:43.430315 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_db.sqlalchemy.engines [None req-d3a0dbc2-153a-4d35-ada7-fe8409864854 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118711) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 01 04:03:43.431480 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO dbcounter [None req-31cea34f-f37b-459e-b306-84ed1548acf8 None None] Registered counter for database nova_cell0 Jul 01 04:03:43.432280 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_db.sqlalchemy.engines [None req-d3a0dbc2-153a-4d35-ada7-fe8409864854 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118711) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 01 04:03:43.435670 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO dbcounter [None req-31cea34f-f37b-459e-b306-84ed1548acf8 None None] Registered counter for database nova_cell1 Jul 01 04:03:43.438660 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG dbcounter [-] [118711] Writer thread running {{(pid=118711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 01 04:03:43.441698 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG dbcounter [-] [118711] Writer thread running {{(pid=118711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 01 04:03:43.443855 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_db.sqlalchemy.engines [None req-31cea34f-f37b-459e-b306-84ed1548acf8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118712) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 01 04:03:43.445242 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_db.sqlalchemy.engines [None req-31cea34f-f37b-459e-b306-84ed1548acf8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118712) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 01 04:03:43.451803 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG dbcounter [-] [118712] Writer thread running {{(pid=118712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 01 04:03:43.453950 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG dbcounter [-] [118712] Writer thread running {{(pid=118712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 01 04:03:43.589807 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO dbcounter [None req-d3a0dbc2-153a-4d35-ada7-fe8409864854 None None] Registered counter for database nova_cell0 Jul 01 04:03:43.598563 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_db.sqlalchemy.engines [None req-d3a0dbc2-153a-4d35-ada7-fe8409864854 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118711) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 01 04:03:43.603508 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG dbcounter [-] [118711] Writer thread running {{(pid=118711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 01 04:03:43.603711 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO dbcounter [None req-31cea34f-f37b-459e-b306-84ed1548acf8 None None] Registered counter for database nova_cell0 Jul 01 04:03:43.611767 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_db.sqlalchemy.engines [None req-31cea34f-f37b-459e-b306-84ed1548acf8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118712) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 01 04:03:43.618097 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG dbcounter [-] [118712] Writer thread running {{(pid=118712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 01 04:03:43.940438 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: WARNING keystonemiddleware.auth_token [None req-d3a0dbc2-153a-4d35-ada7-fe8409864854 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 01 04:03:43.947090 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: WARNING keystonemiddleware.auth_token [None req-31cea34f-f37b-459e-b306-84ed1548acf8 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 01 04:03:43.947694 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: WARNING keystonemiddleware.auth_token [None req-d3a0dbc2-153a-4d35-ada7-fe8409864854 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 01 04:03:43.954977 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: WARNING keystonemiddleware.auth_token [None req-31cea34f-f37b-459e-b306-84ed1548acf8 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 01 04:03:44.289377 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: WARNING keystonemiddleware.auth_token [None req-d3a0dbc2-153a-4d35-ada7-fe8409864854 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 01 04:03:44.295477 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: WARNING keystonemiddleware.auth_token [None req-d3a0dbc2-153a-4d35-ada7-fe8409864854 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 01 04:03:44.300910 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x559a8fdc39c0 pid: 118711 (default app) Jul 01 04:03:44.305271 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: WARNING keystonemiddleware.auth_token [None req-31cea34f-f37b-459e-b306-84ed1548acf8 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 01 04:03:44.311562 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: WARNING keystonemiddleware.auth_token [None req-31cea34f-f37b-459e-b306-84ed1548acf8 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 01 04:03:44.317443 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x559a8fdc39c0 pid: 118712 (default app) Jul 01 04:04:27.132270 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG dbcounter [-] [118711] Writing DB stats nova_api:SELECT=3 {{(pid=118711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:04:27.133215 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG dbcounter [-] [118711] Writing DB stats nova_cell0:SELECT=3 {{(pid=118711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:04:27.133985 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG dbcounter [-] [118711] Writing DB stats nova_cell1:SELECT=3 {{(pid=118711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:04:27.134761 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG dbcounter [-] [118711] Writing DB stats nova_cell0:SELECT=3 {{(pid=118711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:04:27.233329 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG dbcounter [-] [118712] Writing DB stats nova_api:SELECT=3 {{(pid=118712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:04:27.234462 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG dbcounter [-] [118712] Writing DB stats nova_cell0:SELECT=3 {{(pid=118712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:04:27.235663 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG dbcounter [-] [118712] Writing DB stats nova_cell1:SELECT=3 {{(pid=118712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:04:27.236810 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG dbcounter [-] [118712] Writing DB stats nova_cell0:SELECT=3 {{(pid=118712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:04:28.281837 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-79041207-1a5c-4bcd-80c2-0ba3b98a2ad8 tempest-VolumesGetTestJSON-842994040 tempest-VolumesGetTestJSON-842994040-project] Action: 'create', calling method: .version_select at 0x7f99a28193a0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1861621583", "metadata": {"Type": "work"}}} {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 04:04:28.447115 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-0d8a6117-a1f4-405b-bf1c-89be12148d88 tempest-VolumesSnapshotsTestJSON-497193721 tempest-VolumesSnapshotsTestJSON-497193721-project] Action: 'create', calling method: .version_select at 0x7f99a2819430>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1048208657"}} {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 04:04:30.819982 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-79041207-1a5c-4bcd-80c2-0ba3b98a2ad8 tempest-VolumesGetTestJSON-842994040 tempest-VolumesGetTestJSON-842994040-project] 10.222.0.20 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 3.586742 Jul 01 04:04:30.819982 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 1/1] 10.222.0.20 () {60 vars in 1155 bytes} [Fri Jul 1 04:04:27 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 3589 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jul 01 04:04:30.819982 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-289a43ab-c905-43a2-bd5c-17d848eed710 tempest-VolumesGetTestJSON-842994040 tempest-VolumesGetTestJSON-842994040-project] Calling method '.version_select at 0x7f99a26ee280>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:04:30.825446 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-0d8a6117-a1f4-405b-bf1c-89be12148d88 tempest-VolumesSnapshotsTestJSON-497193721 tempest-VolumesSnapshotsTestJSON-497193721-project] 10.222.0.20 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 3.527918 Jul 01 04:04:30.825446 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 1/2] 10.222.0.20 () {60 vars in 1154 bytes} [Fri Jul 1 04:04:27 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 3531 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jul 01 04:04:30.825446 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-4992b443-5731-4fae-baae-b45d2b563bb0 tempest-VolumesSnapshotsTestJSON-497193721 tempest-VolumesSnapshotsTestJSON-497193721-project] Calling method '.version_select at 0x7f99a26e1310>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:04:30.851822 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-289a43ab-c905-43a2-bd5c-17d848eed710 tempest-VolumesGetTestJSON-842994040 tempest-VolumesGetTestJSON-842994040-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/414fce8f-3d04-4129-b564-4edf4da0b6bd" status: 200 len: 353 microversion: 2.1 time: 0.136495 Jul 01 04:04:30.852392 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 2/3] 10.222.0.20 () {58 vars in 1244 bytes} [Fri Jul 1 04:04:30 2022] GET /compute/v2.1/os-volumes/414fce8f-3d04-4129-b564-4edf4da0b6bd => generated 353 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 04:04:30.949163 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-4992b443-5731-4fae-baae-b45d2b563bb0 tempest-VolumesSnapshotsTestJSON-497193721 tempest-VolumesSnapshotsTestJSON-497193721-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/07d0ef34-7e09-4fa9-9ee2-717282ee7b6b" status: 200 len: 345 microversion: 2.1 time: 0.186976 Jul 01 04:04:30.950791 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 2/4] 10.222.0.20 () {58 vars in 1244 bytes} [Fri Jul 1 04:04:30 2022] GET /compute/v2.1/os-volumes/07d0ef34-7e09-4fa9-9ee2-717282ee7b6b => generated 345 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 04:04:31.750887 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-614d7693-c315-4665-8f80-e1c71f48bff2 tempest-VolumesTestJSON-2141312340 tempest-VolumesTestJSON-2141312340-project] Calling method '.version_select at 0x7f99a26ee3a0>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:04:31.865964 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-bf87297a-26a3-4541-8a7d-ec6cd1abd98a tempest-VolumesGetTestJSON-842994040 tempest-VolumesGetTestJSON-842994040-project] Calling method '.version_select at 0x7f99a26e1430>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:04:31.911618 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-614d7693-c315-4665-8f80-e1c71f48bff2 tempest-VolumesTestJSON-2141312340 tempest-VolumesTestJSON-2141312340-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/2ab209f9-6498-4cab-a318-77eb9ddf2d60" status: 200 len: 351 microversion: 2.1 time: 0.173205 Jul 01 04:04:31.912213 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 3/5] 10.222.0.20 () {58 vars in 1244 bytes} [Fri Jul 1 04:04:31 2022] GET /compute/v2.1/os-volumes/2ab209f9-6498-4cab-a318-77eb9ddf2d60 => generated 351 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 04:04:31.975622 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-013a4a40-b2d9-44bc-abb7-9be1d98c5a50 tempest-VolumesSnapshotsTestJSON-497193721 tempest-VolumesSnapshotsTestJSON-497193721-project] Calling method '.version_select at 0x7f99a26eea60>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:04:32.038113 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-bf87297a-26a3-4541-8a7d-ec6cd1abd98a tempest-VolumesGetTestJSON-842994040 tempest-VolumesGetTestJSON-842994040-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/414fce8f-3d04-4129-b564-4edf4da0b6bd" status: 200 len: 354 microversion: 2.1 time: 0.176616 Jul 01 04:04:32.048668 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 3/6] 10.222.0.20 () {58 vars in 1244 bytes} [Fri Jul 1 04:04:31 2022] GET /compute/v2.1/os-volumes/414fce8f-3d04-4129-b564-4edf4da0b6bd => generated 354 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 04:04:32.055668 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-72c227c5-38b9-4383-b964-d30760f8ed3c tempest-VolumesGetTestJSON-842994040 tempest-VolumesGetTestJSON-842994040-project] Calling method '.version_select at 0x7f99a26e1af0>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:04:32.289222 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-013a4a40-b2d9-44bc-abb7-9be1d98c5a50 tempest-VolumesSnapshotsTestJSON-497193721 tempest-VolumesSnapshotsTestJSON-497193721-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/07d0ef34-7e09-4fa9-9ee2-717282ee7b6b" status: 200 len: 346 microversion: 2.1 time: 0.331075 Jul 01 04:04:32.289805 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 4/7] 10.222.0.20 () {58 vars in 1244 bytes} [Fri Jul 1 04:04:31 2022] GET /compute/v2.1/os-volumes/07d0ef34-7e09-4fa9-9ee2-717282ee7b6b => generated 346 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 01 04:04:32.301718 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-6797da80-b9a7-42c5-88d3-f8bb06e0a4aa tempest-VolumesSnapshotsTestJSON-497193721 tempest-VolumesSnapshotsTestJSON-497193721-project] Action: 'create', calling method: .version_select at 0x7f99a26fb160>, body: {"snapshot": {"volume_id": "07d0ef34-7e09-4fa9-9ee2-717282ee7b6b", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1565813376"}} {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 04:04:32.382925 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-72c227c5-38b9-4383-b964-d30760f8ed3c tempest-VolumesGetTestJSON-842994040 tempest-VolumesGetTestJSON-842994040-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/414fce8f-3d04-4129-b564-4edf4da0b6bd" status: 200 len: 354 microversion: 2.1 time: 0.332579 Jul 01 04:04:32.397548 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 4/8] 10.222.0.20 () {58 vars in 1244 bytes} [Fri Jul 1 04:04:32 2022] GET /compute/v2.1/os-volumes/414fce8f-3d04-4129-b564-4edf4da0b6bd => generated 354 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 04:04:32.402953 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-1c777363-6fe8-434d-a01e-724eef254f62 tempest-VolumesGetTestJSON-842994040 tempest-VolumesGetTestJSON-842994040-project] Calling method '.version_select at 0x7f99a26f81f0>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:04:33.316938 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-1c777363-6fe8-434d-a01e-724eef254f62 tempest-VolumesGetTestJSON-842994040 tempest-VolumesGetTestJSON-842994040-project] 10.222.0.20 "DELETE /compute/v2.1/os-volumes/414fce8f-3d04-4129-b564-4edf4da0b6bd" status: 202 len: 0 microversion: 2.1 time: 0.917073 Jul 01 04:04:33.318337 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 5/9] 10.222.0.20 () {58 vars in 1247 bytes} [Fri Jul 1 04:04:32 2022] DELETE /compute/v2.1/os-volumes/414fce8f-3d04-4129-b564-4edf4da0b6bd => generated 0 bytes in 920 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 04:04:33.328077 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-329ed8eb-5f55-4d8d-a5ec-4427c17e4be6 tempest-VolumesGetTestJSON-842994040 tempest-VolumesGetTestJSON-842994040-project] Calling method '.version_select at 0x7f99a26e1c10>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:04:33.491537 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-6797da80-b9a7-42c5-88d3-f8bb06e0a4aa tempest-VolumesSnapshotsTestJSON-497193721 tempest-VolumesSnapshotsTestJSON-497193721-project] 10.222.0.20 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 1.191011 Jul 01 04:04:33.495870 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 5/10] 10.222.0.20 () {60 vars in 1161 bytes} [Fri Jul 1 04:04:32 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 1199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 04:04:33.512569 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-fcca2207-f347-4e93-b7c6-b84c524aa6be tempest-VolumesSnapshotsTestJSON-497193721 tempest-VolumesSnapshotsTestJSON-497193721-project] Calling method '.version_select at 0x7f99a26eeb80>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:04:33.581003 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-329ed8eb-5f55-4d8d-a5ec-4427c17e4be6 tempest-VolumesGetTestJSON-842994040 tempest-VolumesGetTestJSON-842994040-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/414fce8f-3d04-4129-b564-4edf4da0b6bd" status: 200 len: 353 microversion: 2.1 time: 0.258147 Jul 01 04:04:33.583590 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 6/11] 10.222.0.20 () {58 vars in 1244 bytes} [Fri Jul 1 04:04:33 2022] GET /compute/v2.1/os-volumes/414fce8f-3d04-4129-b564-4edf4da0b6bd => generated 353 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 01 04:04:33.648762 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-fcca2207-f347-4e93-b7c6-b84c524aa6be tempest-VolumesSnapshotsTestJSON-497193721 tempest-VolumesSnapshotsTestJSON-497193721-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/7ddd18bb-0d96-40a6-ad30-2b029c93fdf2" status: 200 len: 287 microversion: 2.1 time: 0.144612 Jul 01 04:04:33.654043 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 6/12] 10.222.0.20 () {58 vars in 1250 bytes} [Fri Jul 1 04:04:33 2022] GET /compute/v2.1/os-snapshots/7ddd18bb-0d96-40a6-ad30-2b029c93fdf2 => generated 287 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 04:04:33.659163 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-127a215b-4af6-4119-a8e6-a9de4705df34 tempest-VolumesSnapshotsTestJSON-497193721 tempest-VolumesSnapshotsTestJSON-497193721-project] Calling method '.version_select at 0x7f99a26e11f0>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:04:33.776920 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-127a215b-4af6-4119-a8e6-a9de4705df34 tempest-VolumesSnapshotsTestJSON-497193721 tempest-VolumesSnapshotsTestJSON-497193721-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.122921 Jul 01 04:04:33.778593 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 7/13] 10.222.0.20 () {58 vars in 1139 bytes} [Fri Jul 1 04:04:33 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 04:04:33.791729 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-1a5d72c3-be09-4552-abec-d546f0667076 tempest-VolumesSnapshotsTestJSON-497193721 tempest-VolumesSnapshotsTestJSON-497193721-project] Calling method '.version_select at 0x7f99a26ee1f0>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:04:33.953927 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-1a5d72c3-be09-4552-abec-d546f0667076 tempest-VolumesSnapshotsTestJSON-497193721 tempest-VolumesSnapshotsTestJSON-497193721-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/7ddd18bb-0d96-40a6-ad30-2b029c93fdf2" status: 200 len: 287 microversion: 2.1 time: 0.168102 Jul 01 04:04:33.954510 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 7/14] 10.222.0.20 () {58 vars in 1250 bytes} [Fri Jul 1 04:04:33 2022] GET /compute/v2.1/os-snapshots/7ddd18bb-0d96-40a6-ad30-2b029c93fdf2 => generated 287 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 04:04:34.594247 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-699194f1-e4fd-44ca-a4e1-e15f93fde364 tempest-VolumesGetTestJSON-842994040 tempest-VolumesGetTestJSON-842994040-project] Calling method '.version_select at 0x7f99a26f8820>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:04:34.678336 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.wsgi [None req-699194f1-e4fd-44ca-a4e1-e15f93fde364 tempest-VolumesGetTestJSON-842994040 tempest-VolumesGetTestJSON-842994040-project] HTTP exception thrown: Volume 414fce8f-3d04-4129-b564-4edf4da0b6bd could not be found. Jul 01 04:04:34.692035 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-699194f1-e4fd-44ca-a4e1-e15f93fde364 tempest-VolumesGetTestJSON-842994040 tempest-VolumesGetTestJSON-842994040-project] Request method failure captured: Jul 01 04:04:34.692035 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: request: GET /compute/v2.1/os-volumes/414fce8f-3d04-4129-b564-4edf4da0b6bd HTTP/1.1 Jul 01 04:04:34.692035 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: Accept: application/json Jul 01 04:04:34.692035 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: Accept-Encoding: identity Jul 01 04:04:34.692035 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: Connection: close Jul 01 04:04:34.692035 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: Content-Length: 0 Jul 01 04:04:34.692035 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: Content-Type: application/json Jul 01 04:04:34.692035 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: Host: 10.222.0.20 Jul 01 04:04:34.692035 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: Openstack-System-Scope: None Jul 01 04:04:34.692035 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: User-Agent: python-urllib3/1.26.9 Jul 01 04:04:34.692035 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Auth-Token: gAAAAABivnJLG3ltQjfcp9VZYoDPczwf1MMYmrbDFsNyVBoYRlL9pv3akqD99srcDfgRDbglxC7aSrdgcLcIlsl5N_ADXinTtufutlEkeTSRZV615qaIqFdTENEz7zOOnyICLBjzYpvh79sNtNO62BeHChbO_w4nJLWMWe7-vnXyifhQ-2kXOyM Jul 01 04:04:34.692035 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Domain-Id: None Jul 01 04:04:34.692035 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Domain-Name: None Jul 01 04:04:34.692035 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Identity-Status: Confirmed Jul 01 04:04:34.692035 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Is-Admin-Project: True Jul 01 04:04:34.692035 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Project-Domain-Id: default Jul 01 04:04:34.692035 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Project-Domain-Name: Default Jul 01 04:04:34.692035 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Project-Id: 74f993901b2b497d904ad1e4343954da Jul 01 04:04:34.692035 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Project-Name: tempest-VolumesGetTestJSON-842994040 Jul 01 04:04:34.692035 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Role: reader,member Jul 01 04:04:34.692035 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Roles: reader,member Jul 01 04:04:34.694513 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/74f993901b2b497d904ad1e4343954da"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_74f993901b2b497d904ad1e4343954da", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/74f993901b2b497d904ad1e4343954da"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/74f993901b2b497d904ad1e4343954da"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}] Jul 01 04:04:34.694513 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Tenant: tempest-VolumesGetTestJSON-842994040 Jul 01 04:04:34.694513 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Tenant-Id: 74f993901b2b497d904ad1e4343954da Jul 01 04:04:34.694513 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Tenant-Name: tempest-VolumesGetTestJSON-842994040 Jul 01 04:04:34.694513 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-User: tempest-VolumesGetTestJSON-842994040-project Jul 01 04:04:34.694513 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-User-Domain-Id: default Jul 01 04:04:34.694513 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-User-Domain-Name: Default Jul 01 04:04:34.694513 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-User-Id: b191071f184241908b1260b46c35a8ce Jul 01 04:04:34.694513 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-User-Name: tempest-VolumesGetTestJSON-842994040-project Jul 01 04:04:34.694513 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: method: Jul 01 04:04:34.694513 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: exception: Volume 414fce8f-3d04-4129-b564-4edf4da0b6bd could not be found. Jul 01 04:04:34.694513 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: action_args: {'id': '414fce8f-3d04-4129-b564-4edf4da0b6bd'} Jul 01 04:04:34.694513 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 04:04:34.695804 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 04:04:34.695804 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 01 04:04:34.695804 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 01 04:04:34.695804 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 01 04:04:34.695804 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 01 04:04:34.695804 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 01 04:04:34.695804 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 01 04:04:34.695804 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 01 04:04:34.695804 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 01 04:04:34.695804 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 01 04:04:34.695804 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 01 04:04:34.695804 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 01 04:04:34.695804 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 01 04:04:34.695804 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 01 04:04:34.695804 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 01 04:04:34.695804 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 414fce8f-3d04-4129-b564-4edf4da0b6bd could not be found. (HTTP 404) (Request-ID: req-ea6a0391-0b3a-4ee0-b708-5d22711212f4) Jul 01 04:04:34.695804 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi Jul 01 04:04:34.695804 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 04:04:34.695804 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi Jul 01 04:04:34.697633 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 04:04:34.697633 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 01 04:04:34.697633 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 01 04:04:34.697633 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 01 04:04:34.697633 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 01 04:04:34.697633 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 01 04:04:34.697633 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 01 04:04:34.697633 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 01 04:04:34.697633 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 01 04:04:34.697633 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 01 04:04:34.697633 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 01 04:04:34.697633 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 01 04:04:34.697633 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 01 04:04:34.697633 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 01 04:04:34.697633 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 01 04:04:34.697633 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 01 04:04:34.697633 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 01 04:04:34.697633 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 01 04:04:34.697633 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 01 04:04:34.703752 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 01 04:04:34.703752 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 01 04:04:34.703752 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 01 04:04:34.703752 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 01 04:04:34.703752 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 414fce8f-3d04-4129-b564-4edf4da0b6bd could not be found. Jul 01 04:04:34.703752 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi Jul 01 04:04:34.703752 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 04:04:34.703752 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi Jul 01 04:04:34.703752 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 04:04:34.703752 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 04:04:34.703752 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 04:04:34.703752 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 04:04:34.703752 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 04:04:34.703752 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 01 04:04:34.703752 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 01 04:04:34.703752 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 04:04:34.703752 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 04:04:34.703752 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 01 04:04:34.703752 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 04:04:34.708388 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 414fce8f-3d04-4129-b564-4edf4da0b6bd could not be found. Jul 01 04:04:34.708388 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi Jul 01 04:04:34.708388 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 04:04:34.708388 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi Jul 01 04:04:34.708388 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 04:04:34.708388 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 04:04:34.708388 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 04:04:34.708388 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 04:04:34.708388 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 04:04:34.708388 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 414fce8f-3d04-4129-b564-4edf4da0b6bd could not be found. Jul 01 04:04:34.708388 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi Jul 01 04:04:34.708388 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-699194f1-e4fd-44ca-a4e1-e15f93fde364 tempest-VolumesGetTestJSON-842994040 tempest-VolumesGetTestJSON-842994040-project] Returning 404 to user: Volume 414fce8f-3d04-4129-b564-4edf4da0b6bd could not be found. {{(pid=118712) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 04:04:34.708388 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-699194f1-e4fd-44ca-a4e1-e15f93fde364 tempest-VolumesGetTestJSON-842994040 tempest-VolumesGetTestJSON-842994040-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/414fce8f-3d04-4129-b564-4edf4da0b6bd" status: 404 len: 109 microversion: 2.1 time: 0.098864 Jul 01 04:04:34.708388 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 8/15] 10.222.0.20 () {58 vars in 1244 bytes} [Fri Jul 1 04:04:34 2022] GET /compute/v2.1/os-volumes/414fce8f-3d04-4129-b564-4edf4da0b6bd => generated 109 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 04:04:34.834475 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-ddf4cebd-4d7e-4606-a91b-5faf787a3401 tempest-VolumesTestJSON-2141312340 tempest-VolumesTestJSON-2141312340-project] Calling method '.version_select at 0x7f99a26fb1f0>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:04:34.927709 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-ddf4cebd-4d7e-4606-a91b-5faf787a3401 tempest-VolumesTestJSON-2141312340 tempest-VolumesTestJSON-2141312340-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/429d890c-c6ff-476d-bde6-b1be5d776cae" status: 200 len: 350 microversion: 2.1 time: 0.100587 Jul 01 04:04:34.956018 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 8/16] 10.222.0.20 () {58 vars in 1244 bytes} [Fri Jul 1 04:04:34 2022] GET /compute/v2.1/os-volumes/429d890c-c6ff-476d-bde6-b1be5d776cae => generated 350 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 04:04:34.967387 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-4fb1b1ef-ad48-4128-afe8-c49452ff8675 tempest-VolumesSnapshotsTestJSON-497193721 tempest-VolumesSnapshotsTestJSON-497193721-project] Calling method '.version_select at 0x7f99a26f8790>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:04:35.072420 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-4fb1b1ef-ad48-4128-afe8-c49452ff8675 tempest-VolumesSnapshotsTestJSON-497193721 tempest-VolumesSnapshotsTestJSON-497193721-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/7ddd18bb-0d96-40a6-ad30-2b029c93fdf2" status: 200 len: 287 microversion: 2.1 time: 0.109442 Jul 01 04:04:35.074356 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 9/17] 10.222.0.20 () {58 vars in 1250 bytes} [Fri Jul 1 04:04:34 2022] GET /compute/v2.1/os-snapshots/7ddd18bb-0d96-40a6-ad30-2b029c93fdf2 => generated 287 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 04:04:36.089862 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-9e924f45-f994-425c-a33a-21d50a87ea06 tempest-VolumesSnapshotsTestJSON-497193721 tempest-VolumesSnapshotsTestJSON-497193721-project] Calling method '.version_select at 0x7f99a26fb3a0>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:04:36.198009 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-9e924f45-f994-425c-a33a-21d50a87ea06 tempest-VolumesSnapshotsTestJSON-497193721 tempest-VolumesSnapshotsTestJSON-497193721-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/7ddd18bb-0d96-40a6-ad30-2b029c93fdf2" status: 200 len: 287 microversion: 2.1 time: 0.115928 Jul 01 04:04:36.200177 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 9/18] 10.222.0.20 () {58 vars in 1250 bytes} [Fri Jul 1 04:04:36 2022] GET /compute/v2.1/os-snapshots/7ddd18bb-0d96-40a6-ad30-2b029c93fdf2 => generated 287 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 04:04:37.217053 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-ac2b3c00-121c-41ab-b31a-cb3f7b395406 tempest-VolumesSnapshotsTestJSON-497193721 tempest-VolumesSnapshotsTestJSON-497193721-project] Calling method '.version_select at 0x7f99a26621f0>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:04:37.333786 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-ac2b3c00-121c-41ab-b31a-cb3f7b395406 tempest-VolumesSnapshotsTestJSON-497193721 tempest-VolumesSnapshotsTestJSON-497193721-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/7ddd18bb-0d96-40a6-ad30-2b029c93fdf2" status: 200 len: 288 microversion: 2.1 time: 0.124211 Jul 01 04:04:37.335460 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 10/19] 10.222.0.20 () {58 vars in 1250 bytes} [Fri Jul 1 04:04:37 2022] GET /compute/v2.1/os-snapshots/7ddd18bb-0d96-40a6-ad30-2b029c93fdf2 => generated 288 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 04:04:37.354777 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-317cbb33-d656-4bde-8671-06cf434ec933 tempest-VolumesSnapshotsTestJSON-497193721 tempest-VolumesSnapshotsTestJSON-497193721-project] Calling method '.version_select at 0x7f99a26ee550>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:04:37.585489 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-317cbb33-d656-4bde-8671-06cf434ec933 tempest-VolumesSnapshotsTestJSON-497193721 tempest-VolumesSnapshotsTestJSON-497193721-project] 10.222.0.20 "DELETE /compute/v2.1/os-snapshots/7ddd18bb-0d96-40a6-ad30-2b029c93fdf2" status: 202 len: 0 microversion: 2.1 time: 0.236725 Jul 01 04:04:37.585489 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 10/20] 10.222.0.20 () {58 vars in 1253 bytes} [Fri Jul 1 04:04:37 2022] DELETE /compute/v2.1/os-snapshots/7ddd18bb-0d96-40a6-ad30-2b029c93fdf2 => generated 0 bytes in 240 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 04:04:37.599494 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-fd57c2e1-19ca-49bb-b240-a1f5ca3c378f tempest-VolumesSnapshotsTestJSON-497193721 tempest-VolumesSnapshotsTestJSON-497193721-project] Calling method '.version_select at 0x7f99a26f8d30>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:04:37.758129 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-fd57c2e1-19ca-49bb-b240-a1f5ca3c378f tempest-VolumesSnapshotsTestJSON-497193721 tempest-VolumesSnapshotsTestJSON-497193721-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/7ddd18bb-0d96-40a6-ad30-2b029c93fdf2" status: 200 len: 287 microversion: 2.1 time: 0.166624 Jul 01 04:04:37.765363 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 11/21] 10.222.0.20 () {58 vars in 1250 bytes} [Fri Jul 1 04:04:37 2022] GET /compute/v2.1/os-snapshots/7ddd18bb-0d96-40a6-ad30-2b029c93fdf2 => generated 287 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 04:04:38.170047 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-1a4c2ca8-72b5-41aa-ad5e-1b9c10a5aa6d tempest-VolumesTestJSON-2141312340 tempest-VolumesTestJSON-2141312340-project] Calling method '.version_select at 0x7f99a26eea60>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:04:38.376939 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-1a4c2ca8-72b5-41aa-ad5e-1b9c10a5aa6d tempest-VolumesTestJSON-2141312340 tempest-VolumesTestJSON-2141312340-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/b4f06d67-86fc-4661-afa9-3aacd71ce345" status: 200 len: 351 microversion: 2.1 time: 0.214252 Jul 01 04:04:38.378147 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 11/22] 10.222.0.20 () {58 vars in 1244 bytes} [Fri Jul 1 04:04:38 2022] GET /compute/v2.1/os-volumes/b4f06d67-86fc-4661-afa9-3aacd71ce345 => generated 351 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 04:04:38.395780 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-f2512782-1047-4d71-baed-aa02296340f6 tempest-VolumesTestJSON-2141312340 tempest-VolumesTestJSON-2141312340-project] Calling method '.version_select at 0x7f99a26f8430>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:04:38.737857 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-f2512782-1047-4d71-baed-aa02296340f6 tempest-VolumesTestJSON-2141312340 tempest-VolumesTestJSON-2141312340-project] 10.222.0.20 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.347288 Jul 01 04:04:38.738959 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 12/23] 10.222.0.20 () {58 vars in 1133 bytes} [Fri Jul 1 04:04:38 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:04:38.758120 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-29ad1d55-79f2-4302-9ea7-3b7cc6bb866b tempest-VolumesTestJSON-2141312340 tempest-VolumesTestJSON-2141312340-project] Calling method '.version_select at 0x7f99a26fbc10>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:04:38.777692 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-e5e1aba5-254e-4734-bb4e-bce11138de88 tempest-VolumesSnapshotsTestJSON-497193721 tempest-VolumesSnapshotsTestJSON-497193721-project] Calling method '.version_select at 0x7f99a2662b80>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:04:38.870216 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.wsgi [None req-e5e1aba5-254e-4734-bb4e-bce11138de88 tempest-VolumesSnapshotsTestJSON-497193721 tempest-VolumesSnapshotsTestJSON-497193721-project] HTTP exception thrown: Snapshot 7ddd18bb-0d96-40a6-ad30-2b029c93fdf2 could not be found. Jul 01 04:04:38.873397 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-e5e1aba5-254e-4734-bb4e-bce11138de88 tempest-VolumesSnapshotsTestJSON-497193721 tempest-VolumesSnapshotsTestJSON-497193721-project] Request method failure captured: Jul 01 04:04:38.873397 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: request: GET /compute/v2.1/os-snapshots/7ddd18bb-0d96-40a6-ad30-2b029c93fdf2 HTTP/1.1 Jul 01 04:04:38.873397 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: Accept: application/json Jul 01 04:04:38.873397 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: Accept-Encoding: identity Jul 01 04:04:38.873397 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: Connection: close Jul 01 04:04:38.873397 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: Content-Length: 0 Jul 01 04:04:38.873397 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: Content-Type: application/json Jul 01 04:04:38.873397 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: Host: 10.222.0.20 Jul 01 04:04:38.873397 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: Openstack-System-Scope: None Jul 01 04:04:38.873397 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: User-Agent: python-urllib3/1.26.9 Jul 01 04:04:38.873397 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Auth-Token: gAAAAABivnJLE1tLm9XM0qLgluTXZ0tk-6O7heovMjRbHNdebDbhgE6yasj2P6Qy1KsU0J6iWMP-bLQtWxabbrzlp6bUcxnjHneF7MzT-NeMbMxYAXozndVj5dHGd7DcAJLPcINrqHkoQljfRupmfe3EaY3JPgP7xL6DtaJcNfCz8Oz8rj-hW0s Jul 01 04:04:38.873397 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Domain-Id: None Jul 01 04:04:38.873397 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Domain-Name: None Jul 01 04:04:38.873397 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Identity-Status: Confirmed Jul 01 04:04:38.873397 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Is-Admin-Project: True Jul 01 04:04:38.873397 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Project-Domain-Id: default Jul 01 04:04:38.873397 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Project-Domain-Name: Default Jul 01 04:04:38.873397 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Project-Id: f80f7c3079364d238d394945f393bb75 Jul 01 04:04:38.873397 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-497193721 Jul 01 04:04:38.873397 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Role: reader,member Jul 01 04:04:38.873397 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Roles: reader,member Jul 01 04:04:38.874496 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/f80f7c3079364d238d394945f393bb75"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_f80f7c3079364d238d394945f393bb75", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f80f7c3079364d238d394945f393bb75"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f80f7c3079364d238d394945f393bb75"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}] Jul 01 04:04:38.874496 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Tenant: tempest-VolumesSnapshotsTestJSON-497193721 Jul 01 04:04:38.874496 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Tenant-Id: f80f7c3079364d238d394945f393bb75 Jul 01 04:04:38.874496 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-497193721 Jul 01 04:04:38.874496 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-User: tempest-VolumesSnapshotsTestJSON-497193721-project Jul 01 04:04:38.874496 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-User-Domain-Id: default Jul 01 04:04:38.874496 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-User-Domain-Name: Default Jul 01 04:04:38.874496 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-User-Id: 57dd68408eb14eda9586e4d1283a563e Jul 01 04:04:38.874496 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-User-Name: tempest-VolumesSnapshotsTestJSON-497193721-project Jul 01 04:04:38.874496 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: method: Jul 01 04:04:38.874496 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: exception: Snapshot 7ddd18bb-0d96-40a6-ad30-2b029c93fdf2 could not be found. Jul 01 04:04:38.874496 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: action_args: {'id': '7ddd18bb-0d96-40a6-ad30-2b029c93fdf2'} Jul 01 04:04:38.874496 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 04:04:38.876265 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 04:04:38.876265 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 01 04:04:38.876265 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 01 04:04:38.876265 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 01 04:04:38.876265 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 01 04:04:38.876265 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 01 04:04:38.876265 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 01 04:04:38.876265 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 01 04:04:38.876265 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 01 04:04:38.876265 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 01 04:04:38.876265 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 01 04:04:38.876265 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 01 04:04:38.876265 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 01 04:04:38.876265 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 01 04:04:38.876265 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 01 04:04:38.876265 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 7ddd18bb-0d96-40a6-ad30-2b029c93fdf2 could not be found. (HTTP 404) (Request-ID: req-45efd292-1705-4fa1-ab7c-3f53fa460a10) Jul 01 04:04:38.876265 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi Jul 01 04:04:38.876265 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 04:04:38.877623 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi Jul 01 04:04:38.877623 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 04:04:38.877623 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jul 01 04:04:38.877623 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jul 01 04:04:38.877623 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 01 04:04:38.877623 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 01 04:04:38.877623 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jul 01 04:04:38.877623 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jul 01 04:04:38.877623 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 01 04:04:38.877623 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 01 04:04:38.877623 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 01 04:04:38.877623 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 01 04:04:38.877623 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 01 04:04:38.877623 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 01 04:04:38.877623 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 01 04:04:38.877623 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 01 04:04:38.877623 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 01 04:04:38.877623 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 01 04:04:38.877623 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 01 04:04:38.878487 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 01 04:04:38.878487 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 01 04:04:38.878487 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 01 04:04:38.878487 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 01 04:04:38.878487 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 01 04:04:38.878487 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 7ddd18bb-0d96-40a6-ad30-2b029c93fdf2 could not be found. Jul 01 04:04:38.878487 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi Jul 01 04:04:38.878487 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 04:04:38.878487 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi Jul 01 04:04:38.878487 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 04:04:38.878487 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 04:04:38.878487 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 04:04:38.878487 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 04:04:38.878487 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 04:04:38.878487 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 01 04:04:38.878487 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 01 04:04:38.878487 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 04:04:38.878487 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 04:04:38.878487 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jul 01 04:04:38.878487 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 04:04:38.879399 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 7ddd18bb-0d96-40a6-ad30-2b029c93fdf2 could not be found. Jul 01 04:04:38.879399 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi Jul 01 04:04:38.879399 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 04:04:38.879399 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi Jul 01 04:04:38.879399 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 04:04:38.879399 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 04:04:38.879399 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 04:04:38.879399 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 04:04:38.879399 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 04:04:38.879399 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 7ddd18bb-0d96-40a6-ad30-2b029c93fdf2 could not be found. Jul 01 04:04:38.879399 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi Jul 01 04:04:38.884176 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-e5e1aba5-254e-4734-bb4e-bce11138de88 tempest-VolumesSnapshotsTestJSON-497193721 tempest-VolumesSnapshotsTestJSON-497193721-project] Returning 404 to user: Snapshot 7ddd18bb-0d96-40a6-ad30-2b029c93fdf2 could not be found. {{(pid=118712) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 04:04:38.885195 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-e5e1aba5-254e-4734-bb4e-bce11138de88 tempest-VolumesSnapshotsTestJSON-497193721 tempest-VolumesSnapshotsTestJSON-497193721-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/7ddd18bb-0d96-40a6-ad30-2b029c93fdf2" status: 404 len: 111 microversion: 2.1 time: 0.112156 Jul 01 04:04:38.885948 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 13/24] 10.222.0.20 () {58 vars in 1250 bytes} [Fri Jul 1 04:04:38 2022] GET /compute/v2.1/os-snapshots/7ddd18bb-0d96-40a6-ad30-2b029c93fdf2 => generated 111 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 04:04:38.905660 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-a9eb3971-775b-440b-98a7-9adbdcc08707 tempest-VolumesSnapshotsTestJSON-497193721 tempest-VolumesSnapshotsTestJSON-497193721-project] Calling method '.version_select at 0x7f99a26620d0>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:04:39.272879 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-a9eb3971-775b-440b-98a7-9adbdcc08707 tempest-VolumesSnapshotsTestJSON-497193721 tempest-VolumesSnapshotsTestJSON-497193721-project] 10.222.0.20 "DELETE /compute/v2.1/os-volumes/07d0ef34-7e09-4fa9-9ee2-717282ee7b6b" status: 202 len: 0 microversion: 2.1 time: 0.380650 Jul 01 04:04:39.274243 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 14/25] 10.222.0.20 () {58 vars in 1247 bytes} [Fri Jul 1 04:04:38 2022] DELETE /compute/v2.1/os-volumes/07d0ef34-7e09-4fa9-9ee2-717282ee7b6b => generated 0 bytes in 383 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 04:04:39.286154 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-ada202b0-fd16-4c57-a02f-03f7c7f820fe tempest-VolumesSnapshotsTestJSON-497193721 tempest-VolumesSnapshotsTestJSON-497193721-project] Calling method '.version_select at 0x7f99a26f8160>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:04:39.325031 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-29ad1d55-79f2-4302-9ea7-3b7cc6bb866b tempest-VolumesTestJSON-2141312340 tempest-VolumesTestJSON-2141312340-project] 10.222.0.20 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.571948 Jul 01 04:04:39.326024 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 12/26] 10.222.0.20 () {58 vars in 1148 bytes} [Fri Jul 1 04:04:38 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 04:04:39.347718 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-ae3b0a92-59f8-45f8-9159-7d9baa21545a tempest-VolumesTestJSON-2141312340 tempest-VolumesTestJSON-2141312340-project] Calling method '.version_select at 0x7f99a26eef70>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:04:39.413942 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-ada202b0-fd16-4c57-a02f-03f7c7f820fe tempest-VolumesSnapshotsTestJSON-497193721 tempest-VolumesSnapshotsTestJSON-497193721-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/07d0ef34-7e09-4fa9-9ee2-717282ee7b6b" status: 200 len: 345 microversion: 2.1 time: 0.132939 Jul 01 04:04:39.415962 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 15/27] 10.222.0.20 () {58 vars in 1244 bytes} [Fri Jul 1 04:04:39 2022] GET /compute/v2.1/os-volumes/07d0ef34-7e09-4fa9-9ee2-717282ee7b6b => generated 345 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 04:04:39.780543 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-ae3b0a92-59f8-45f8-9159-7d9baa21545a tempest-VolumesTestJSON-2141312340 tempest-VolumesTestJSON-2141312340-project] 10.222.0.20 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.441357 Jul 01 04:04:39.783605 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 13/28] 10.222.0.20 () {58 vars in 1133 bytes} [Fri Jul 1 04:04:39 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:04:39.799011 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-5792042e-f02e-42b9-8085-d00229f2ed80 tempest-VolumesTestJSON-2141312340 tempest-VolumesTestJSON-2141312340-project] Calling method '.version_select at 0x7f99a26f8dc0>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:04:40.141305 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-5792042e-f02e-42b9-8085-d00229f2ed80 tempest-VolumesTestJSON-2141312340 tempest-VolumesTestJSON-2141312340-project] 10.222.0.20 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.343479 Jul 01 04:04:40.141305 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 16/29] 10.222.0.20 () {58 vars in 1166 bytes} [Fri Jul 1 04:04:39 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 04:04:40.154455 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-33f7662a-ad1d-4c2a-91fb-9e7c83d40b28 tempest-VolumesTestJSON-2141312340 tempest-VolumesTestJSON-2141312340-project] Calling method '.version_select at 0x7f99a26f8280>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:04:40.372890 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-33f7662a-ad1d-4c2a-91fb-9e7c83d40b28 tempest-VolumesTestJSON-2141312340 tempest-VolumesTestJSON-2141312340-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.224604 Jul 01 04:04:40.380388 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 17/30] 10.222.0.20 () {58 vars in 1169 bytes} [Fri Jul 1 04:04:40 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 04:04:40.388939 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-e79145ff-2eb8-426a-b550-7a78de2c2ee7 tempest-VolumesTestJSON-2141312340 tempest-VolumesTestJSON-2141312340-project] Calling method '.version_select at 0x7f99a2662c10>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:04:40.594655 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-e79145ff-2eb8-426a-b550-7a78de2c2ee7 tempest-VolumesTestJSON-2141312340 tempest-VolumesTestJSON-2141312340-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.212645 Jul 01 04:04:40.613673 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 18/31] 10.222.0.20 () {58 vars in 1154 bytes} [Fri Jul 1 04:04:40 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:04:40.620178 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-2cba4e8f-057d-418b-b35b-e0bb1817f99b tempest-VolumesSnapshotsTestJSON-497193721 tempest-VolumesSnapshotsTestJSON-497193721-project] Calling method '.version_select at 0x7f99a266e3a0>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:04:40.677270 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.wsgi [None req-2cba4e8f-057d-418b-b35b-e0bb1817f99b tempest-VolumesSnapshotsTestJSON-497193721 tempest-VolumesSnapshotsTestJSON-497193721-project] HTTP exception thrown: Volume 07d0ef34-7e09-4fa9-9ee2-717282ee7b6b could not be found. Jul 01 04:04:40.681317 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-2cba4e8f-057d-418b-b35b-e0bb1817f99b tempest-VolumesSnapshotsTestJSON-497193721 tempest-VolumesSnapshotsTestJSON-497193721-project] Request method failure captured: Jul 01 04:04:40.681317 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: request: GET /compute/v2.1/os-volumes/07d0ef34-7e09-4fa9-9ee2-717282ee7b6b HTTP/1.1 Jul 01 04:04:40.681317 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: Accept: application/json Jul 01 04:04:40.681317 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: Accept-Encoding: identity Jul 01 04:04:40.681317 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: Connection: close Jul 01 04:04:40.681317 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: Content-Length: 0 Jul 01 04:04:40.681317 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: Content-Type: application/json Jul 01 04:04:40.681317 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: Host: 10.222.0.20 Jul 01 04:04:40.681317 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: Openstack-System-Scope: None Jul 01 04:04:40.681317 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: User-Agent: python-urllib3/1.26.9 Jul 01 04:04:40.681317 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Auth-Token: gAAAAABivnJLE1tLm9XM0qLgluTXZ0tk-6O7heovMjRbHNdebDbhgE6yasj2P6Qy1KsU0J6iWMP-bLQtWxabbrzlp6bUcxnjHneF7MzT-NeMbMxYAXozndVj5dHGd7DcAJLPcINrqHkoQljfRupmfe3EaY3JPgP7xL6DtaJcNfCz8Oz8rj-hW0s Jul 01 04:04:40.681317 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Domain-Id: None Jul 01 04:04:40.681317 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Domain-Name: None Jul 01 04:04:40.681317 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Identity-Status: Confirmed Jul 01 04:04:40.681317 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Is-Admin-Project: True Jul 01 04:04:40.681317 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Project-Domain-Id: default Jul 01 04:04:40.681317 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Project-Domain-Name: Default Jul 01 04:04:40.681317 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Project-Id: f80f7c3079364d238d394945f393bb75 Jul 01 04:04:40.681317 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-497193721 Jul 01 04:04:40.681317 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Role: reader,member Jul 01 04:04:40.681317 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Roles: reader,member Jul 01 04:04:40.682446 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/f80f7c3079364d238d394945f393bb75"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_f80f7c3079364d238d394945f393bb75", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f80f7c3079364d238d394945f393bb75"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f80f7c3079364d238d394945f393bb75"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}] Jul 01 04:04:40.682446 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Tenant: tempest-VolumesSnapshotsTestJSON-497193721 Jul 01 04:04:40.682446 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Tenant-Id: f80f7c3079364d238d394945f393bb75 Jul 01 04:04:40.682446 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-497193721 Jul 01 04:04:40.682446 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-User: tempest-VolumesSnapshotsTestJSON-497193721-project Jul 01 04:04:40.682446 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-User-Domain-Id: default Jul 01 04:04:40.682446 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-User-Domain-Name: Default Jul 01 04:04:40.682446 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-User-Id: 57dd68408eb14eda9586e4d1283a563e Jul 01 04:04:40.682446 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-User-Name: tempest-VolumesSnapshotsTestJSON-497193721-project Jul 01 04:04:40.682446 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: method: Jul 01 04:04:40.682446 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: exception: Volume 07d0ef34-7e09-4fa9-9ee2-717282ee7b6b could not be found. Jul 01 04:04:40.682446 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: action_args: {'id': '07d0ef34-7e09-4fa9-9ee2-717282ee7b6b'} Jul 01 04:04:40.682446 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 04:04:40.683138 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 04:04:40.683138 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 01 04:04:40.683138 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 01 04:04:40.683138 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 01 04:04:40.683138 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 01 04:04:40.683138 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 01 04:04:40.683138 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 01 04:04:40.683138 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 01 04:04:40.683138 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 01 04:04:40.683138 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 01 04:04:40.683138 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 01 04:04:40.683138 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 01 04:04:40.683138 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 01 04:04:40.683138 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 01 04:04:40.683138 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 01 04:04:40.683138 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 07d0ef34-7e09-4fa9-9ee2-717282ee7b6b could not be found. (HTTP 404) (Request-ID: req-cdb9de9f-c019-4973-a68c-9c60fc1b2b3b) Jul 01 04:04:40.683138 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi Jul 01 04:04:40.683138 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 04:04:40.683138 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi Jul 01 04:04:40.684252 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 04:04:40.684252 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 01 04:04:40.684252 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 01 04:04:40.684252 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 01 04:04:40.684252 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 01 04:04:40.684252 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 01 04:04:40.684252 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 01 04:04:40.684252 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 01 04:04:40.684252 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 01 04:04:40.684252 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 01 04:04:40.684252 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 01 04:04:40.684252 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 01 04:04:40.684252 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 01 04:04:40.684252 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 01 04:04:40.684252 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 01 04:04:40.684252 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 01 04:04:40.684252 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 01 04:04:40.684252 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 01 04:04:40.684252 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 01 04:04:40.685119 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 01 04:04:40.685119 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 01 04:04:40.685119 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 01 04:04:40.685119 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 01 04:04:40.685119 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 07d0ef34-7e09-4fa9-9ee2-717282ee7b6b could not be found. Jul 01 04:04:40.685119 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi Jul 01 04:04:40.685119 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 04:04:40.685119 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi Jul 01 04:04:40.685119 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 04:04:40.685119 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 04:04:40.685119 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 04:04:40.685119 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 04:04:40.685119 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 04:04:40.685119 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 01 04:04:40.685119 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 01 04:04:40.685119 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 04:04:40.685119 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 04:04:40.685119 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 01 04:04:40.685119 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 04:04:40.685975 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 07d0ef34-7e09-4fa9-9ee2-717282ee7b6b could not be found. Jul 01 04:04:40.685975 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi Jul 01 04:04:40.685975 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 04:04:40.685975 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi Jul 01 04:04:40.685975 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 04:04:40.685975 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 04:04:40.685975 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 04:04:40.685975 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 04:04:40.685975 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 04:04:40.685975 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 07d0ef34-7e09-4fa9-9ee2-717282ee7b6b could not be found. Jul 01 04:04:40.685975 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi Jul 01 04:04:40.685975 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-2cba4e8f-057d-418b-b35b-e0bb1817f99b tempest-VolumesSnapshotsTestJSON-497193721 tempest-VolumesSnapshotsTestJSON-497193721-project] Returning 404 to user: Volume 07d0ef34-7e09-4fa9-9ee2-717282ee7b6b could not be found. {{(pid=118712) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 04:04:40.685975 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-2cba4e8f-057d-418b-b35b-e0bb1817f99b tempest-VolumesSnapshotsTestJSON-497193721 tempest-VolumesSnapshotsTestJSON-497193721-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/07d0ef34-7e09-4fa9-9ee2-717282ee7b6b" status: 404 len: 109 microversion: 2.1 time: 0.069325 Jul 01 04:04:40.692517 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-8b1b3d19-94c7-4bea-aa94-3e8c176d6e9f tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1143832670", "imageRef": "66f9f4ba-339c-4967-8857-d65299a66629", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 04:04:40.692622 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 19/32] 10.222.0.20 () {58 vars in 1244 bytes} [Fri Jul 1 04:04:40 2022] GET /compute/v2.1/os-volumes/07d0ef34-7e09-4fa9-9ee2-717282ee7b6b => generated 109 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 04:04:40.705979 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-fd23d8be-973c-4953-a1df-825769642899 tempest-VolumesTestJSON-2141312340 tempest-VolumesTestJSON-2141312340-project] Calling method '.version_select at 0x7f99a2662940>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:04:40.927637 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.network.neutron [None req-8b1b3d19-94c7-4bea-aa94-3e8c176d6e9f tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] validate_networks() for [('75365ee4-4f3f-4dcc-b151-ec870f7f38ce', None, None, None, None, None)] {{(pid=118711) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 01 04:04:40.990653 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-fd23d8be-973c-4953-a1df-825769642899 tempest-VolumesTestJSON-2141312340 tempest-VolumesTestJSON-2141312340-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.300514 Jul 01 04:04:40.994505 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 20/33] 10.222.0.20 () {58 vars in 1187 bytes} [Fri Jul 1 04:04:40 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 04:04:41.007707 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-abca1e52-6dc1-47a3-8652-049c94584ca0 tempest-VolumesSnapshotsTestJSON-497193721 tempest-VolumesSnapshotsTestJSON-497193721-project] Calling method '.version_select at 0x7f99a26f80d0>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:04:41.056837 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.wsgi [None req-abca1e52-6dc1-47a3-8652-049c94584ca0 tempest-VolumesSnapshotsTestJSON-497193721 tempest-VolumesSnapshotsTestJSON-497193721-project] HTTP exception thrown: Volume 07d0ef34-7e09-4fa9-9ee2-717282ee7b6b could not be found. Jul 01 04:04:41.060647 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-abca1e52-6dc1-47a3-8652-049c94584ca0 tempest-VolumesSnapshotsTestJSON-497193721 tempest-VolumesSnapshotsTestJSON-497193721-project] Request method failure captured: Jul 01 04:04:41.060647 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: request: DELETE /compute/v2.1/os-volumes/07d0ef34-7e09-4fa9-9ee2-717282ee7b6b HTTP/1.1 Jul 01 04:04:41.060647 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: Accept: application/json Jul 01 04:04:41.060647 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: Accept-Encoding: identity Jul 01 04:04:41.060647 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: Connection: close Jul 01 04:04:41.060647 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: Content-Length: 0 Jul 01 04:04:41.060647 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: Content-Type: application/json Jul 01 04:04:41.060647 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: Host: 10.222.0.20 Jul 01 04:04:41.060647 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: Openstack-System-Scope: None Jul 01 04:04:41.060647 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: User-Agent: python-urllib3/1.26.9 Jul 01 04:04:41.060647 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Auth-Token: gAAAAABivnJLE1tLm9XM0qLgluTXZ0tk-6O7heovMjRbHNdebDbhgE6yasj2P6Qy1KsU0J6iWMP-bLQtWxabbrzlp6bUcxnjHneF7MzT-NeMbMxYAXozndVj5dHGd7DcAJLPcINrqHkoQljfRupmfe3EaY3JPgP7xL6DtaJcNfCz8Oz8rj-hW0s Jul 01 04:04:41.060647 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Domain-Id: None Jul 01 04:04:41.060647 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Domain-Name: None Jul 01 04:04:41.060647 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Identity-Status: Confirmed Jul 01 04:04:41.060647 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Is-Admin-Project: True Jul 01 04:04:41.060647 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Project-Domain-Id: default Jul 01 04:04:41.060647 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Project-Domain-Name: Default Jul 01 04:04:41.060647 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Project-Id: f80f7c3079364d238d394945f393bb75 Jul 01 04:04:41.060647 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-497193721 Jul 01 04:04:41.060647 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Role: reader,member Jul 01 04:04:41.060647 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Roles: reader,member Jul 01 04:04:41.062001 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/f80f7c3079364d238d394945f393bb75"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_f80f7c3079364d238d394945f393bb75", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f80f7c3079364d238d394945f393bb75"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f80f7c3079364d238d394945f393bb75"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}] Jul 01 04:04:41.062001 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Tenant: tempest-VolumesSnapshotsTestJSON-497193721 Jul 01 04:04:41.062001 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Tenant-Id: f80f7c3079364d238d394945f393bb75 Jul 01 04:04:41.062001 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-497193721 Jul 01 04:04:41.062001 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-User: tempest-VolumesSnapshotsTestJSON-497193721-project Jul 01 04:04:41.062001 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-User-Domain-Id: default Jul 01 04:04:41.062001 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-User-Domain-Name: Default Jul 01 04:04:41.062001 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-User-Id: 57dd68408eb14eda9586e4d1283a563e Jul 01 04:04:41.062001 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-User-Name: tempest-VolumesSnapshotsTestJSON-497193721-project Jul 01 04:04:41.062001 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: method: Jul 01 04:04:41.062001 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: exception: Volume 07d0ef34-7e09-4fa9-9ee2-717282ee7b6b could not be found. Jul 01 04:04:41.062001 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: action_args: {'id': '07d0ef34-7e09-4fa9-9ee2-717282ee7b6b'} Jul 01 04:04:41.062001 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 04:04:41.062605 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 04:04:41.062605 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 01 04:04:41.062605 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 01 04:04:41.062605 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 01 04:04:41.062605 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 01 04:04:41.062605 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 01 04:04:41.062605 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 01 04:04:41.062605 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 01 04:04:41.062605 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 01 04:04:41.062605 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 01 04:04:41.062605 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 01 04:04:41.062605 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 01 04:04:41.062605 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 01 04:04:41.062605 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 01 04:04:41.062605 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 01 04:04:41.062605 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 07d0ef34-7e09-4fa9-9ee2-717282ee7b6b could not be found. (HTTP 404) (Request-ID: req-b100a8bb-f508-4011-9edd-2f548db0e45d) Jul 01 04:04:41.062605 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi Jul 01 04:04:41.062605 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 04:04:41.062605 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi Jul 01 04:04:41.063841 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 04:04:41.063841 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 01 04:04:41.063841 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 01 04:04:41.063841 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 01 04:04:41.063841 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 01 04:04:41.063841 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 01 04:04:41.063841 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 01 04:04:41.063841 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 01 04:04:41.063841 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 01 04:04:41.063841 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 01 04:04:41.063841 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 01 04:04:41.063841 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 01 04:04:41.063841 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 01 04:04:41.063841 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 01 04:04:41.063841 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 01 04:04:41.063841 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 01 04:04:41.063841 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 01 04:04:41.063841 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 01 04:04:41.063841 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 01 04:04:41.064944 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 01 04:04:41.064944 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 01 04:04:41.064944 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 01 04:04:41.064944 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 01 04:04:41.064944 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 07d0ef34-7e09-4fa9-9ee2-717282ee7b6b could not be found. Jul 01 04:04:41.064944 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi Jul 01 04:04:41.064944 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 04:04:41.064944 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi Jul 01 04:04:41.064944 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 04:04:41.064944 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 04:04:41.064944 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 04:04:41.064944 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 04:04:41.064944 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 04:04:41.064944 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 01 04:04:41.064944 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 01 04:04:41.064944 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 04:04:41.064944 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 04:04:41.064944 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 01 04:04:41.064944 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 04:04:41.066846 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 07d0ef34-7e09-4fa9-9ee2-717282ee7b6b could not be found. Jul 01 04:04:41.066846 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi Jul 01 04:04:41.066846 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 04:04:41.066846 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi Jul 01 04:04:41.066846 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 04:04:41.066846 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 04:04:41.066846 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 04:04:41.066846 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 04:04:41.066846 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 04:04:41.066846 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 07d0ef34-7e09-4fa9-9ee2-717282ee7b6b could not be found. Jul 01 04:04:41.066846 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi Jul 01 04:04:41.066846 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-abca1e52-6dc1-47a3-8652-049c94584ca0 tempest-VolumesSnapshotsTestJSON-497193721 tempest-VolumesSnapshotsTestJSON-497193721-project] Returning 404 to user: Volume 07d0ef34-7e09-4fa9-9ee2-717282ee7b6b could not be found. {{(pid=118712) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 04:04:41.066846 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-abca1e52-6dc1-47a3-8652-049c94584ca0 tempest-VolumesSnapshotsTestJSON-497193721 tempest-VolumesSnapshotsTestJSON-497193721-project] 10.222.0.20 "DELETE /compute/v2.1/os-volumes/07d0ef34-7e09-4fa9-9ee2-717282ee7b6b" status: 404 len: 109 microversion: 2.1 time: 0.059182 Jul 01 04:04:41.066846 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 21/34] 10.222.0.20 () {58 vars in 1247 bytes} [Fri Jul 1 04:04:40 2022] DELETE /compute/v2.1/os-volumes/07d0ef34-7e09-4fa9-9ee2-717282ee7b6b => generated 109 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 04:04:41.078084 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-be476bcd-9de3-4140-a1d7-871a46b6a6a5 tempest-VolumesTestJSON-2141312340 tempest-VolumesTestJSON-2141312340-project] Calling method '.version_select at 0x7f99a26f8670>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:04:41.252296 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-be476bcd-9de3-4140-a1d7-871a46b6a6a5 tempest-VolumesTestJSON-2141312340 tempest-VolumesTestJSON-2141312340-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.183146 Jul 01 04:04:41.272695 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 22/35] 10.222.0.20 () {58 vars in 1154 bytes} [Fri Jul 1 04:04:41 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:04:41.287686 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-a7e8ddeb-4fe2-4dd0-8af5-48c2facca19d tempest-VolumesSnapshotsTestJSON-497193721 tempest-VolumesSnapshotsTestJSON-497193721-project] Calling method '.version_select at 0x7f99a2662790>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:04:41.360450 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.wsgi [None req-a7e8ddeb-4fe2-4dd0-8af5-48c2facca19d tempest-VolumesSnapshotsTestJSON-497193721 tempest-VolumesSnapshotsTestJSON-497193721-project] HTTP exception thrown: Volume 07d0ef34-7e09-4fa9-9ee2-717282ee7b6b could not be found. Jul 01 04:04:41.363774 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-a7e8ddeb-4fe2-4dd0-8af5-48c2facca19d tempest-VolumesSnapshotsTestJSON-497193721 tempest-VolumesSnapshotsTestJSON-497193721-project] Request method failure captured: Jul 01 04:04:41.363774 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: request: GET /compute/v2.1/os-volumes/07d0ef34-7e09-4fa9-9ee2-717282ee7b6b HTTP/1.1 Jul 01 04:04:41.363774 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: Accept: application/json Jul 01 04:04:41.363774 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: Accept-Encoding: identity Jul 01 04:04:41.363774 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: Connection: close Jul 01 04:04:41.363774 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: Content-Length: 0 Jul 01 04:04:41.363774 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: Content-Type: application/json Jul 01 04:04:41.363774 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: Host: 10.222.0.20 Jul 01 04:04:41.363774 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: Openstack-System-Scope: None Jul 01 04:04:41.363774 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: User-Agent: python-urllib3/1.26.9 Jul 01 04:04:41.363774 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Auth-Token: gAAAAABivnJLE1tLm9XM0qLgluTXZ0tk-6O7heovMjRbHNdebDbhgE6yasj2P6Qy1KsU0J6iWMP-bLQtWxabbrzlp6bUcxnjHneF7MzT-NeMbMxYAXozndVj5dHGd7DcAJLPcINrqHkoQljfRupmfe3EaY3JPgP7xL6DtaJcNfCz8Oz8rj-hW0s Jul 01 04:04:41.363774 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Domain-Id: None Jul 01 04:04:41.363774 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Domain-Name: None Jul 01 04:04:41.363774 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Identity-Status: Confirmed Jul 01 04:04:41.363774 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Is-Admin-Project: True Jul 01 04:04:41.363774 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Project-Domain-Id: default Jul 01 04:04:41.363774 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Project-Domain-Name: Default Jul 01 04:04:41.363774 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Project-Id: f80f7c3079364d238d394945f393bb75 Jul 01 04:04:41.363774 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-497193721 Jul 01 04:04:41.363774 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Role: reader,member Jul 01 04:04:41.363774 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Roles: reader,member Jul 01 04:04:41.365817 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/f80f7c3079364d238d394945f393bb75"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_f80f7c3079364d238d394945f393bb75", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f80f7c3079364d238d394945f393bb75"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f80f7c3079364d238d394945f393bb75"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}] Jul 01 04:04:41.365817 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Tenant: tempest-VolumesSnapshotsTestJSON-497193721 Jul 01 04:04:41.365817 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Tenant-Id: f80f7c3079364d238d394945f393bb75 Jul 01 04:04:41.365817 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-497193721 Jul 01 04:04:41.365817 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-User: tempest-VolumesSnapshotsTestJSON-497193721-project Jul 01 04:04:41.365817 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-User-Domain-Id: default Jul 01 04:04:41.365817 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-User-Domain-Name: Default Jul 01 04:04:41.365817 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-User-Id: 57dd68408eb14eda9586e4d1283a563e Jul 01 04:04:41.365817 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-User-Name: tempest-VolumesSnapshotsTestJSON-497193721-project Jul 01 04:04:41.365817 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: method: Jul 01 04:04:41.365817 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: exception: Volume 07d0ef34-7e09-4fa9-9ee2-717282ee7b6b could not be found. Jul 01 04:04:41.365817 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: action_args: {'id': '07d0ef34-7e09-4fa9-9ee2-717282ee7b6b'} Jul 01 04:04:41.365817 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 04:04:41.367283 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 04:04:41.367283 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 01 04:04:41.367283 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 01 04:04:41.367283 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 01 04:04:41.367283 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 01 04:04:41.367283 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 01 04:04:41.367283 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 01 04:04:41.367283 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 01 04:04:41.367283 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 01 04:04:41.367283 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 01 04:04:41.367283 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 01 04:04:41.367283 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 01 04:04:41.367283 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 01 04:04:41.367283 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 01 04:04:41.367283 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 01 04:04:41.367283 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 07d0ef34-7e09-4fa9-9ee2-717282ee7b6b could not be found. (HTTP 404) (Request-ID: req-170a3fad-7d8c-4203-a437-c1abc9461cfd) Jul 01 04:04:41.367283 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi Jul 01 04:04:41.367283 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 04:04:41.367283 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi Jul 01 04:04:41.369588 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 04:04:41.369588 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 01 04:04:41.369588 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 01 04:04:41.369588 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 01 04:04:41.369588 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 01 04:04:41.369588 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 01 04:04:41.369588 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 01 04:04:41.369588 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 01 04:04:41.369588 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 01 04:04:41.369588 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 01 04:04:41.369588 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 01 04:04:41.369588 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 01 04:04:41.369588 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 01 04:04:41.369588 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 01 04:04:41.369588 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 01 04:04:41.369588 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 01 04:04:41.369588 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 01 04:04:41.369588 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 01 04:04:41.369588 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 01 04:04:41.377143 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 01 04:04:41.377143 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 01 04:04:41.377143 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 01 04:04:41.377143 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 01 04:04:41.377143 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 07d0ef34-7e09-4fa9-9ee2-717282ee7b6b could not be found. Jul 01 04:04:41.377143 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi Jul 01 04:04:41.377143 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 04:04:41.377143 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi Jul 01 04:04:41.377143 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 04:04:41.377143 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 04:04:41.377143 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 04:04:41.377143 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 04:04:41.377143 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 04:04:41.377143 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 01 04:04:41.377143 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 01 04:04:41.377143 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 04:04:41.377143 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 04:04:41.377143 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 01 04:04:41.377143 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 04:04:41.379299 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 07d0ef34-7e09-4fa9-9ee2-717282ee7b6b could not be found. Jul 01 04:04:41.379299 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi Jul 01 04:04:41.379299 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 04:04:41.379299 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi Jul 01 04:04:41.379299 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 04:04:41.379299 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 04:04:41.379299 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 04:04:41.379299 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 04:04:41.379299 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 04:04:41.379299 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 07d0ef34-7e09-4fa9-9ee2-717282ee7b6b could not be found. Jul 01 04:04:41.379299 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi Jul 01 04:04:41.379299 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-a7e8ddeb-4fe2-4dd0-8af5-48c2facca19d tempest-VolumesSnapshotsTestJSON-497193721 tempest-VolumesSnapshotsTestJSON-497193721-project] Returning 404 to user: Volume 07d0ef34-7e09-4fa9-9ee2-717282ee7b6b could not be found. {{(pid=118712) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 04:04:41.379299 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-a7e8ddeb-4fe2-4dd0-8af5-48c2facca19d tempest-VolumesSnapshotsTestJSON-497193721 tempest-VolumesSnapshotsTestJSON-497193721-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/07d0ef34-7e09-4fa9-9ee2-717282ee7b6b" status: 404 len: 109 microversion: 2.1 time: 0.100349 Jul 01 04:04:41.382389 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 23/36] 10.222.0.20 () {58 vars in 1244 bytes} [Fri Jul 1 04:04:41 2022] GET /compute/v2.1/os-volumes/07d0ef34-7e09-4fa9-9ee2-717282ee7b6b => generated 109 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 04:04:42.835401 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-c674627b-0c50-4576-b877-525c453772dc tempest-DeleteServersTestJSON-285930608 tempest-DeleteServersTestJSON-285930608-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1120447146", "imageRef": "66f9f4ba-339c-4967-8857-d65299a66629", "flavorRef": "452", "networks": [{"uuid": "4dd837b4-313d-454f-adc5-46ba1c3efcc0"}]}} {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 04:04:43.034709 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.network.neutron [None req-c674627b-0c50-4576-b877-525c453772dc tempest-DeleteServersTestJSON-285930608 tempest-DeleteServersTestJSON-285930608-project] validate_networks() for [('4dd837b4-313d-454f-adc5-46ba1c3efcc0', None, None, None, None, None)] {{(pid=118712) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 01 04:04:43.988629 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.virt.hardware [None req-8b1b3d19-94c7-4bea-aa94-3e8c176d6e9f tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Flavor limits 0:0:0 {{(pid=118711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 01 04:04:43.989128 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.virt.hardware [None req-8b1b3d19-94c7-4bea-aa94-3e8c176d6e9f tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Image limits 0:0:0 {{(pid=118711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 01 04:04:43.989496 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.virt.hardware [None req-8b1b3d19-94c7-4bea-aa94-3e8c176d6e9f tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Flavor pref 0:0:0 {{(pid=118711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 01 04:04:43.989976 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.virt.hardware [None req-8b1b3d19-94c7-4bea-aa94-3e8c176d6e9f tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Image pref 0:0:0 {{(pid=118711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 01 04:04:43.990401 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.virt.hardware [None req-8b1b3d19-94c7-4bea-aa94-3e8c176d6e9f tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 01 04:04:44.024649 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-8b1b3d19-94c7-4bea-aa94-3e8c176d6e9f tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:04:44.025101 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-8b1b3d19-94c7-4bea-aa94-3e8c176d6e9f tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:04:44.026827 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-8b1b3d19-94c7-4bea-aa94-3e8c176d6e9f tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:04:44.027296 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-8b1b3d19-94c7-4bea-aa94-3e8c176d6e9f tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:04:44.138508 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.quota [None req-8b1b3d19-94c7-4bea-aa94-3e8c176d6e9f tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Getting quotas for project f0143140d4f649478e36abcee284640c. Resources: {'ram', 'cores', 'instances'} {{(pid=118711) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 04:04:44.153185 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.quota [None req-8b1b3d19-94c7-4bea-aa94-3e8c176d6e9f tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Getting quotas for user 8622ec5212c84d87b9b7c8f725012a07 and project f0143140d4f649478e36abcee284640c. Resources: {'ram', 'cores', 'instances'} {{(pid=118711) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 04:04:44.181918 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-8b1b3d19-94c7-4bea-aa94-3e8c176d6e9f tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Going to run 1 instances... {{(pid=118711) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 01 04:04:44.186176 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-8b1b3d19-94c7-4bea-aa94-3e8c176d6e9f tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] [instance: cd6bb9ca-aa57-4dc3-98bc-8e3194003673] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='66f9f4ba-339c-4967-8857-d65299a66629',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118711) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 01 04:04:44.508784 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-8b1b3d19-94c7-4bea-aa94-3e8c176d6e9f tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 4.434885 Jul 01 04:04:44.513980 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 14/37] 10.222.0.20 () {60 vars in 1146 bytes} [Fri Jul 1 04:04:40 2022] POST /compute/v2.1/servers => generated 383 bytes in 4442 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 01 04:04:45.823980 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-70761808-4452-44ea-a9ea-7496afc4f384 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Action: 'create', calling method: .version_select at 0x7f99a25f4e50>, body: {"keypair": {"name": "tempest-keypair-1881303120", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF6Dqn0iL6oS2hdsaQl+N29pFzPIxJlop995B+mGUA1pnbnK0Qq6gM/fmeOwlTsJC/HITWcATbGQhGaOpmwu2n+CRzS0DHaSTg7Gn3sFLDFYRWvpjTe9yFtvnlIQw/gmjg=="}} {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 04:04:45.953223 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.quota [None req-70761808-4452-44ea-a9ea-7496afc4f384 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Getting quotas for project 9dccdb0188264f2686d7275e19f39d05. Resources: {'key_pairs'} {{(pid=118711) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 04:04:45.980704 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.quota [None req-70761808-4452-44ea-a9ea-7496afc4f384 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Getting quotas for user 708734ba3ddc49a3a9dba1d891aeccc7 and project 9dccdb0188264f2686d7275e19f39d05. Resources: {'key_pairs'} {{(pid=118711) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 04:04:46.274500 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-70761808-4452-44ea-a9ea-7496afc4f384 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 1.744981 Jul 01 04:04:46.275118 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 15/38] 10.222.0.20 () {62 vars in 1199 bytes} [Fri Jul 1 04:04:44 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 1750 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 01 04:04:46.302742 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-1ad307d2-bfc8-428b-8a9c-c953e7faea4e tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:04:46.302742 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-1ad307d2-bfc8-428b-8a9c-c953e7faea4e tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] [instance: cd6bb9ca-aa57-4dc3-98bc-8e3194003673] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:04:46.526600 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-1ad307d2-bfc8-428b-8a9c-c953e7faea4e tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8622ec5212c84d87b9b7c8f725012a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0143140d4f649478e36abcee284640c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:04:46.612441 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-1ad307d2-bfc8-428b-8a9c-c953e7faea4e tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] 10.222.0.20 "GET /compute/v2.1/servers/cd6bb9ca-aa57-4dc3-98bc-8e3194003673" status: 200 len: 1222 microversion: 2.1 time: 0.335736 Jul 01 04:04:46.616884 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 16/39] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:04:46 2022] GET /compute/v2.1/servers/cd6bb9ca-aa57-4dc3-98bc-8e3194003673 => generated 1222 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:04:46.698876 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.virt.hardware [None req-c674627b-0c50-4576-b877-525c453772dc tempest-DeleteServersTestJSON-285930608 tempest-DeleteServersTestJSON-285930608-project] Flavor limits 0:0:0 {{(pid=118712) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 01 04:04:46.699494 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.virt.hardware [None req-c674627b-0c50-4576-b877-525c453772dc tempest-DeleteServersTestJSON-285930608 tempest-DeleteServersTestJSON-285930608-project] Image limits 0:0:0 {{(pid=118712) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 01 04:04:46.700139 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.virt.hardware [None req-c674627b-0c50-4576-b877-525c453772dc tempest-DeleteServersTestJSON-285930608 tempest-DeleteServersTestJSON-285930608-project] Flavor pref 0:0:0 {{(pid=118712) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 01 04:04:46.700487 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.virt.hardware [None req-c674627b-0c50-4576-b877-525c453772dc tempest-DeleteServersTestJSON-285930608 tempest-DeleteServersTestJSON-285930608-project] Image pref 0:0:0 {{(pid=118712) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 01 04:04:46.700908 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.virt.hardware [None req-c674627b-0c50-4576-b877-525c453772dc tempest-DeleteServersTestJSON-285930608 tempest-DeleteServersTestJSON-285930608-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118712) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 01 04:04:46.722238 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-c674627b-0c50-4576-b877-525c453772dc tempest-DeleteServersTestJSON-285930608 tempest-DeleteServersTestJSON-285930608-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:04:46.724705 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-c674627b-0c50-4576-b877-525c453772dc tempest-DeleteServersTestJSON-285930608 tempest-DeleteServersTestJSON-285930608-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:04:46.724705 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-c674627b-0c50-4576-b877-525c453772dc tempest-DeleteServersTestJSON-285930608 tempest-DeleteServersTestJSON-285930608-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:04:46.724705 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-c674627b-0c50-4576-b877-525c453772dc tempest-DeleteServersTestJSON-285930608 tempest-DeleteServersTestJSON-285930608-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:04:46.800797 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.quota [None req-c674627b-0c50-4576-b877-525c453772dc tempest-DeleteServersTestJSON-285930608 tempest-DeleteServersTestJSON-285930608-project] Getting quotas for project cb56c390ed7649479455d6dc3904deb0. Resources: {'ram', 'cores', 'instances'} {{(pid=118712) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 04:04:46.813180 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.quota [None req-c674627b-0c50-4576-b877-525c453772dc tempest-DeleteServersTestJSON-285930608 tempest-DeleteServersTestJSON-285930608-project] Getting quotas for user 8ab2da92b7e94592b80ef3d7852f51ae and project cb56c390ed7649479455d6dc3904deb0. Resources: {'ram', 'cores', 'instances'} {{(pid=118712) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 04:04:46.858015 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-c674627b-0c50-4576-b877-525c453772dc tempest-DeleteServersTestJSON-285930608 tempest-DeleteServersTestJSON-285930608-project] Going to run 1 instances... {{(pid=118712) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 01 04:04:46.876786 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-c674627b-0c50-4576-b877-525c453772dc tempest-DeleteServersTestJSON-285930608 tempest-DeleteServersTestJSON-285930608-project] [instance: 3858eceb-54a4-4bac-beef-8acd0afafba7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='66f9f4ba-339c-4967-8857-d65299a66629',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118712) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 01 04:04:47.277684 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-c674627b-0c50-4576-b877-525c453772dc tempest-DeleteServersTestJSON-285930608 tempest-DeleteServersTestJSON-285930608-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 5.193627 Jul 01 04:04:47.278780 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 24/40] 10.222.0.20 () {60 vars in 1146 bytes} [Fri Jul 1 04:04:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 5196 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 01 04:04:47.296017 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-e07f20d2-109e-45bd-97ab-c75de5cfd0bf tempest-DeleteServersTestJSON-285930608 tempest-DeleteServersTestJSON-285930608-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:04:47.299030 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-e07f20d2-109e-45bd-97ab-c75de5cfd0bf tempest-DeleteServersTestJSON-285930608 tempest-DeleteServersTestJSON-285930608-project] [instance: 3858eceb-54a4-4bac-beef-8acd0afafba7] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:04:47.476106 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-e07f20d2-109e-45bd-97ab-c75de5cfd0bf tempest-DeleteServersTestJSON-285930608 tempest-DeleteServersTestJSON-285930608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab2da92b7e94592b80ef3d7852f51ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb56c390ed7649479455d6dc3904deb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:04:47.487152 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-e07f20d2-109e-45bd-97ab-c75de5cfd0bf tempest-DeleteServersTestJSON-285930608 tempest-DeleteServersTestJSON-285930608-project] 10.222.0.20 "GET /compute/v2.1/servers/3858eceb-54a4-4bac-beef-8acd0afafba7" status: 200 len: 1215 microversion: 2.1 time: 0.201581 Jul 01 04:04:47.496997 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 17/41] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:04:47 2022] GET /compute/v2.1/servers/3858eceb-54a4-4bac-beef-8acd0afafba7 => generated 1215 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:04:47.759890 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-f5d830ff-9a9a-45ed-b2c2-500bf56a61a5 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-3070267", "imageRef": "66f9f4ba-339c-4967-8857-d65299a66629", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 04:04:47.835097 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.network.neutron [None req-f5d830ff-9a9a-45ed-b2c2-500bf56a61a5 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] validate_networks() for [('75365ee4-4f3f-4dcc-b151-ec870f7f38ce', None, None, None, None, None)] {{(pid=118712) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 01 04:04:48.506211 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-e9dd3605-b3ce-48ad-aa91-c31e2ba696db tempest-DeleteServersTestJSON-285930608 tempest-DeleteServersTestJSON-285930608-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:04:48.506948 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-e9dd3605-b3ce-48ad-aa91-c31e2ba696db tempest-DeleteServersTestJSON-285930608 tempest-DeleteServersTestJSON-285930608-project] [instance: 3858eceb-54a4-4bac-beef-8acd0afafba7] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:04:48.801443 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-e9dd3605-b3ce-48ad-aa91-c31e2ba696db tempest-DeleteServersTestJSON-285930608 tempest-DeleteServersTestJSON-285930608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab2da92b7e94592b80ef3d7852f51ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb56c390ed7649479455d6dc3904deb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:04:48.827053 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-e9dd3605-b3ce-48ad-aa91-c31e2ba696db tempest-DeleteServersTestJSON-285930608 tempest-DeleteServersTestJSON-285930608-project] 10.222.0.20 "GET /compute/v2.1/servers/3858eceb-54a4-4bac-beef-8acd0afafba7" status: 200 len: 1215 microversion: 2.1 time: 0.325481 Jul 01 04:04:48.829677 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 18/42] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:04:48 2022] GET /compute/v2.1/servers/3858eceb-54a4-4bac-beef-8acd0afafba7 => generated 1215 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:04:48.958971 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.virt.hardware [None req-f5d830ff-9a9a-45ed-b2c2-500bf56a61a5 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Flavor limits 0:0:0 {{(pid=118712) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 01 04:04:48.960892 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.virt.hardware [None req-f5d830ff-9a9a-45ed-b2c2-500bf56a61a5 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Image limits 0:0:0 {{(pid=118712) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 01 04:04:48.962624 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.virt.hardware [None req-f5d830ff-9a9a-45ed-b2c2-500bf56a61a5 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Flavor pref 0:0:0 {{(pid=118712) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 01 04:04:48.963591 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.virt.hardware [None req-f5d830ff-9a9a-45ed-b2c2-500bf56a61a5 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Image pref 0:0:0 {{(pid=118712) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 01 04:04:48.964654 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.virt.hardware [None req-f5d830ff-9a9a-45ed-b2c2-500bf56a61a5 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118712) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 01 04:04:48.986929 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-f5d830ff-9a9a-45ed-b2c2-500bf56a61a5 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:04:48.987998 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-f5d830ff-9a9a-45ed-b2c2-500bf56a61a5 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:04:48.989879 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-f5d830ff-9a9a-45ed-b2c2-500bf56a61a5 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:04:48.990727 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-f5d830ff-9a9a-45ed-b2c2-500bf56a61a5 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:04:49.034373 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.quota [None req-f5d830ff-9a9a-45ed-b2c2-500bf56a61a5 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Getting quotas for project f0143140d4f649478e36abcee284640c. Resources: {'ram', 'cores', 'instances'} {{(pid=118712) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 04:04:49.040252 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.quota [None req-f5d830ff-9a9a-45ed-b2c2-500bf56a61a5 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Getting quotas for user 8622ec5212c84d87b9b7c8f725012a07 and project f0143140d4f649478e36abcee284640c. Resources: {'ram', 'cores', 'instances'} {{(pid=118712) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 04:04:49.066521 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-f5d830ff-9a9a-45ed-b2c2-500bf56a61a5 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Going to run 1 instances... {{(pid=118712) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 01 04:04:49.070172 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-f5d830ff-9a9a-45ed-b2c2-500bf56a61a5 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] [instance: f0c5fb50-4991-45b2-803d-7bcfe51f7c34] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='66f9f4ba-339c-4967-8857-d65299a66629',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118712) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 01 04:04:49.418714 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-f5d830ff-9a9a-45ed-b2c2-500bf56a61a5 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.664640 Jul 01 04:04:49.435155 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 25/43] 10.222.0.20 () {60 vars in 1146 bytes} [Fri Jul 1 04:04:47 2022] POST /compute/v2.1/servers => generated 383 bytes in 1683 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 01 04:04:49.441912 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-c91645f7-ec5a-47f5-95fe-1cc975b475b5 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:04:49.442835 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-c91645f7-ec5a-47f5-95fe-1cc975b475b5 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] [instance: f0c5fb50-4991-45b2-803d-7bcfe51f7c34] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:04:49.853074 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-679eb0ec-ed4b-4b7c-9df3-a97efe066481 tempest-DeleteServersTestJSON-285930608 tempest-DeleteServersTestJSON-285930608-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:04:49.853732 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-679eb0ec-ed4b-4b7c-9df3-a97efe066481 tempest-DeleteServersTestJSON-285930608 tempest-DeleteServersTestJSON-285930608-project] [instance: 3858eceb-54a4-4bac-beef-8acd0afafba7] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:04:49.970853 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-c91645f7-ec5a-47f5-95fe-1cc975b475b5 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8622ec5212c84d87b9b7c8f725012a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0143140d4f649478e36abcee284640c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:04:49.980044 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-c91645f7-ec5a-47f5-95fe-1cc975b475b5 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] 10.222.0.20 "GET /compute/v2.1/servers/f0c5fb50-4991-45b2-803d-7bcfe51f7c34" status: 200 len: 1219 microversion: 2.1 time: 0.543587 Jul 01 04:04:49.988941 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 19/44] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:04:49 2022] GET /compute/v2.1/servers/f0c5fb50-4991-45b2-803d-7bcfe51f7c34 => generated 1219 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:04:50.270471 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-679eb0ec-ed4b-4b7c-9df3-a97efe066481 tempest-DeleteServersTestJSON-285930608 tempest-DeleteServersTestJSON-285930608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab2da92b7e94592b80ef3d7852f51ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb56c390ed7649479455d6dc3904deb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:04:50.309789 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-679eb0ec-ed4b-4b7c-9df3-a97efe066481 tempest-DeleteServersTestJSON-285930608 tempest-DeleteServersTestJSON-285930608-project] 10.222.0.20 "GET /compute/v2.1/servers/3858eceb-54a4-4bac-beef-8acd0afafba7" status: 200 len: 1215 microversion: 2.1 time: 0.458224 Jul 01 04:04:50.311327 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 26/45] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:04:49 2022] GET /compute/v2.1/servers/3858eceb-54a4-4bac-beef-8acd0afafba7 => generated 1215 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:04:51.023183 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-bbc32689-323d-4bd7-9692-ee5ccdf355a1 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:04:51.023857 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-bbc32689-323d-4bd7-9692-ee5ccdf355a1 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] [instance: f0c5fb50-4991-45b2-803d-7bcfe51f7c34] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:04:51.221425 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-bbc32689-323d-4bd7-9692-ee5ccdf355a1 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8622ec5212c84d87b9b7c8f725012a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0143140d4f649478e36abcee284640c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:04:51.248645 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-bbc32689-323d-4bd7-9692-ee5ccdf355a1 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] 10.222.0.20 "GET /compute/v2.1/servers/f0c5fb50-4991-45b2-803d-7bcfe51f7c34" status: 200 len: 1219 microversion: 2.1 time: 0.230794 Jul 01 04:04:51.249235 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 20/46] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:04:51 2022] GET /compute/v2.1/servers/f0c5fb50-4991-45b2-803d-7bcfe51f7c34 => generated 1219 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 04:04:51.343319 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-70f6869f-3ba9-43fb-9208-31a61f160ee1 tempest-DeleteServersTestJSON-285930608 tempest-DeleteServersTestJSON-285930608-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:04:51.343319 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-70f6869f-3ba9-43fb-9208-31a61f160ee1 tempest-DeleteServersTestJSON-285930608 tempest-DeleteServersTestJSON-285930608-project] [instance: 3858eceb-54a4-4bac-beef-8acd0afafba7] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:04:51.455478 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-70f6869f-3ba9-43fb-9208-31a61f160ee1 tempest-DeleteServersTestJSON-285930608 tempest-DeleteServersTestJSON-285930608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab2da92b7e94592b80ef3d7852f51ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb56c390ed7649479455d6dc3904deb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:04:51.467629 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-70f6869f-3ba9-43fb-9208-31a61f160ee1 tempest-DeleteServersTestJSON-285930608 tempest-DeleteServersTestJSON-285930608-project] 10.222.0.20 "GET /compute/v2.1/servers/3858eceb-54a4-4bac-beef-8acd0afafba7" status: 200 len: 1215 microversion: 2.1 time: 0.131382 Jul 01 04:04:51.468670 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 27/47] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:04:51 2022] GET /compute/v2.1/servers/3858eceb-54a4-4bac-beef-8acd0afafba7 => generated 1215 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 04:04:52.280531 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-847f9b6d-4832-4bb6-a52e-8b139405b472 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:04:52.281348 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-847f9b6d-4832-4bb6-a52e-8b139405b472 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] [instance: f0c5fb50-4991-45b2-803d-7bcfe51f7c34] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:04:52.296339 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-847f9b6d-4832-4bb6-a52e-8b139405b472 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:04:52.296919 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-847f9b6d-4832-4bb6-a52e-8b139405b472 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:04:52.302110 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-847f9b6d-4832-4bb6-a52e-8b139405b472 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:04:52.304247 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-847f9b6d-4832-4bb6-a52e-8b139405b472 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:04:52.489983 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-809b591d-c6cb-4259-9691-46706fd771f0 tempest-DeleteServersTestJSON-285930608 tempest-DeleteServersTestJSON-285930608-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:04:52.490752 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-809b591d-c6cb-4259-9691-46706fd771f0 tempest-DeleteServersTestJSON-285930608 tempest-DeleteServersTestJSON-285930608-project] [instance: 3858eceb-54a4-4bac-beef-8acd0afafba7] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:04:52.528597 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-809b591d-c6cb-4259-9691-46706fd771f0 tempest-DeleteServersTestJSON-285930608 tempest-DeleteServersTestJSON-285930608-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:04:52.529316 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-809b591d-c6cb-4259-9691-46706fd771f0 tempest-DeleteServersTestJSON-285930608 tempest-DeleteServersTestJSON-285930608-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:04:52.530181 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-809b591d-c6cb-4259-9691-46706fd771f0 tempest-DeleteServersTestJSON-285930608 tempest-DeleteServersTestJSON-285930608-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:04:52.530639 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-809b591d-c6cb-4259-9691-46706fd771f0 tempest-DeleteServersTestJSON-285930608 tempest-DeleteServersTestJSON-285930608-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:04:52.606032 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-847f9b6d-4832-4bb6-a52e-8b139405b472 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8622ec5212c84d87b9b7c8f725012a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0143140d4f649478e36abcee284640c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:04:52.625685 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-847f9b6d-4832-4bb6-a52e-8b139405b472 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] 10.222.0.20 "GET /compute/v2.1/servers/f0c5fb50-4991-45b2-803d-7bcfe51f7c34" status: 200 len: 1223 microversion: 2.1 time: 0.349346 Jul 01 04:04:52.629733 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 21/48] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:04:52 2022] GET /compute/v2.1/servers/f0c5fb50-4991-45b2-803d-7bcfe51f7c34 => generated 1223 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 04:04:52.644154 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-1d37da45-cd03-46e6-8304-e518d1aacfe6 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1299536004", "imageRef": "66f9f4ba-339c-4967-8857-d65299a66629", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "7ad440ac-7067-4e8d-bf57-cf4af7de94b6"}], "security_groups": [{"name": "tempest-securitygroup--1827710956"}], "key_name": "tempest-keypair-1881303120", "user_data": "}} {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 04:04:52.949013 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.network.neutron [None req-1d37da45-cd03-46e6-8304-e518d1aacfe6 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] validate_networks() for [('7ad440ac-7067-4e8d-bf57-cf4af7de94b6', None, None, None, None, None)] {{(pid=118711) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 01 04:04:53.026459 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-809b591d-c6cb-4259-9691-46706fd771f0 tempest-DeleteServersTestJSON-285930608 tempest-DeleteServersTestJSON-285930608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab2da92b7e94592b80ef3d7852f51ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb56c390ed7649479455d6dc3904deb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:04:53.081442 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-809b591d-c6cb-4259-9691-46706fd771f0 tempest-DeleteServersTestJSON-285930608 tempest-DeleteServersTestJSON-285930608-project] 10.222.0.20 "GET /compute/v2.1/servers/3858eceb-54a4-4bac-beef-8acd0afafba7" status: 200 len: 1211 microversion: 2.1 time: 0.598165 Jul 01 04:04:53.106630 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 28/49] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:04:52 2022] GET /compute/v2.1/servers/3858eceb-54a4-4bac-beef-8acd0afafba7 => generated 1211 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:04:53.576202 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.virt.hardware [None req-1d37da45-cd03-46e6-8304-e518d1aacfe6 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Flavor limits 0:0:0 {{(pid=118711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 01 04:04:53.578366 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.virt.hardware [None req-1d37da45-cd03-46e6-8304-e518d1aacfe6 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Image limits 0:0:0 {{(pid=118711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 01 04:04:53.580414 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.virt.hardware [None req-1d37da45-cd03-46e6-8304-e518d1aacfe6 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Flavor pref 0:0:0 {{(pid=118711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 01 04:04:53.580928 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.virt.hardware [None req-1d37da45-cd03-46e6-8304-e518d1aacfe6 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Image pref 0:0:0 {{(pid=118711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 01 04:04:53.581359 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.virt.hardware [None req-1d37da45-cd03-46e6-8304-e518d1aacfe6 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 01 04:04:53.596167 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-1d37da45-cd03-46e6-8304-e518d1aacfe6 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:04:53.596636 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-1d37da45-cd03-46e6-8304-e518d1aacfe6 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:04:53.597712 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-1d37da45-cd03-46e6-8304-e518d1aacfe6 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:04:53.598900 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-1d37da45-cd03-46e6-8304-e518d1aacfe6 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:04:53.624672 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.quota [None req-1d37da45-cd03-46e6-8304-e518d1aacfe6 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Getting quotas for project 9dccdb0188264f2686d7275e19f39d05. Resources: {'ram', 'cores', 'instances'} {{(pid=118711) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 04:04:53.630697 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.quota [None req-1d37da45-cd03-46e6-8304-e518d1aacfe6 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Getting quotas for user 708734ba3ddc49a3a9dba1d891aeccc7 and project 9dccdb0188264f2686d7275e19f39d05. Resources: {'ram', 'cores', 'instances'} {{(pid=118711) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 04:04:53.646681 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-1d37da45-cd03-46e6-8304-e518d1aacfe6 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Going to run 1 instances... {{(pid=118711) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 01 04:04:53.649595 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-1d37da45-cd03-46e6-8304-e518d1aacfe6 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] [instance: b904f233-887c-4c96-a2d2-f7f415ad852f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='66f9f4ba-339c-4967-8857-d65299a66629',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118711) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 01 04:04:53.799179 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-1d37da45-cd03-46e6-8304-e518d1aacfe6 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.167316 Jul 01 04:04:53.807973 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 22/50] 10.222.0.20 () {62 vars in 1187 bytes} [Fri Jul 1 04:04:52 2022] POST /compute/v2.1/servers => generated 402 bytes in 1177 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 01 04:04:53.814440 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-8509d2e3-e9ae-48d0-a00c-7df7db65656e tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:04:53.815073 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-8509d2e3-e9ae-48d0-a00c-7df7db65656e tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] [instance: f0c5fb50-4991-45b2-803d-7bcfe51f7c34] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:04:53.839735 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-8509d2e3-e9ae-48d0-a00c-7df7db65656e tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:04:53.845198 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-8509d2e3-e9ae-48d0-a00c-7df7db65656e tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:04:53.845794 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-8509d2e3-e9ae-48d0-a00c-7df7db65656e tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:04:53.846833 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-8509d2e3-e9ae-48d0-a00c-7df7db65656e tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:04:53.940083 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-8509d2e3-e9ae-48d0-a00c-7df7db65656e tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8622ec5212c84d87b9b7c8f725012a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0143140d4f649478e36abcee284640c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:04:53.948842 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-8509d2e3-e9ae-48d0-a00c-7df7db65656e tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] 10.222.0.20 "GET /compute/v2.1/servers/f0c5fb50-4991-45b2-803d-7bcfe51f7c34" status: 200 len: 1271 microversion: 2.1 time: 0.139437 Jul 01 04:04:53.950021 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 23/51] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:04:53 2022] GET /compute/v2.1/servers/f0c5fb50-4991-45b2-803d-7bcfe51f7c34 => generated 1271 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:04:53.956023 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-0373e7e7-bd13-4d44-95e5-ef2d0331c3e0 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:04:53.957839 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-0373e7e7-bd13-4d44-95e5-ef2d0331c3e0 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] [instance: b904f233-887c-4c96-a2d2-f7f415ad852f] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:04:54.012241 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-9b089d93-ab54-4755-8744-5448770dd5ff tempest-VolumesNegativeTest-21800228 tempest-VolumesNegativeTest-21800228-project] Action: 'create', calling method: .version_select at 0x7f99a149c550>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-455016825", "metadata": {"Type": "work"}}} {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 04:04:54.038216 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-9b089d93-ab54-4755-8744-5448770dd5ff tempest-VolumesNegativeTest-21800228 tempest-VolumesNegativeTest-21800228-project] Request method failure captured: Jul 01 04:04:54.038216 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 01 04:04:54.038216 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: Accept: application/json Jul 01 04:04:54.038216 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: Accept-Encoding: identity Jul 01 04:04:54.038216 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: Connection: close Jul 01 04:04:54.038216 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: Content-Length: 121 Jul 01 04:04:54.038216 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: Content-Type: application/json Jul 01 04:04:54.038216 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: Host: 10.222.0.20 Jul 01 04:04:54.038216 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: Openstack-System-Scope: None Jul 01 04:04:54.038216 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: User-Agent: python-urllib3/1.26.9 Jul 01 04:04:54.038216 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Auth-Token: gAAAAABivnJlz94J85LLOQzbnf4Rl5v7XqbvfXaepfTAoqGsZpgf_fCpR6XNyHGfO_MUpasOaGlvarrA1nq6ITA7fgjlffrE6PUx5tBExMti4gC4ucR9sX0_36G7lM8LRWp_XcATMIXyHfgrqYEPI2ylQIWmK1dHLtTtTxaLqT1-4aGoHW2rIhE Jul 01 04:04:54.038216 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Domain-Id: None Jul 01 04:04:54.038216 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Domain-Name: None Jul 01 04:04:54.038216 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Identity-Status: Confirmed Jul 01 04:04:54.038216 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Is-Admin-Project: True Jul 01 04:04:54.038216 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Project-Domain-Id: default Jul 01 04:04:54.038216 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Project-Domain-Name: Default Jul 01 04:04:54.038216 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Project-Id: c79c8683f6614a9a9d883be0553d6b7e Jul 01 04:04:54.038216 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Project-Name: tempest-VolumesNegativeTest-21800228 Jul 01 04:04:54.038216 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Role: reader,member Jul 01 04:04:54.038216 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Roles: reader,member Jul 01 04:04:54.039667 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/c79c8683f6614a9a9d883be0553d6b7e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_c79c8683f6614a9a9d883be0553d6b7e", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c79c8683f6614a9a9d883be0553d6b7e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c79c8683f6614a9a9d883be0553d6b7e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}] Jul 01 04:04:54.039667 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Tenant: tempest-VolumesNegativeTest-21800228 Jul 01 04:04:54.039667 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Tenant-Id: c79c8683f6614a9a9d883be0553d6b7e Jul 01 04:04:54.039667 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Tenant-Name: tempest-VolumesNegativeTest-21800228 Jul 01 04:04:54.039667 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-User: tempest-VolumesNegativeTest-21800228-project Jul 01 04:04:54.039667 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-User-Domain-Id: default Jul 01 04:04:54.039667 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-User-Domain-Name: Default Jul 01 04:04:54.039667 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-User-Id: 9abd4bb809fa40689e8b2ad77b936a0f Jul 01 04:04:54.039667 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-User-Name: tempest-VolumesNegativeTest-21800228-project Jul 01 04:04:54.039667 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: Jul 01 04:04:54.039667 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-455016825", "metadata": {"Type": "work"}}} Jul 01 04:04:54.039667 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: method: Jul 01 04:04:54.039667 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 01 04:04:54.040481 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-455016825', 'metadata': {'Type': 'work'}}}} Jul 01 04:04:54.040481 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 04:04:54.040481 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 04:04:54.040481 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 01 04:04:54.040481 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 01 04:04:54.040481 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 01 04:04:54.040481 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi raise error Jul 01 04:04:54.040481 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jul 01 04:04:54.040481 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi Jul 01 04:04:54.040481 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 01 04:04:54.040481 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 01 04:04:54.040481 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi Jul 01 04:04:54.040481 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 01 04:04:54.040481 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi '#$%' Jul 01 04:04:54.040481 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi Jul 01 04:04:54.040481 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 04:04:54.040481 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi Jul 01 04:04:54.040481 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 04:04:54.040481 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 04:04:54.040481 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 04:04:54.040481 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 04:04:54.040481 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 04:04:54.042142 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 01 04:04:54.042142 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 01 04:04:54.042142 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 04:04:54.042142 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 04:04:54.042142 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 01 04:04:54.042142 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 01 04:04:54.042142 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 01 04:04:54.042142 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 01 04:04:54.042142 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 01 04:04:54.042142 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 01 04:04:54.042142 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 01 04:04:54.042142 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi Jul 01 04:04:54.042142 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 04:04:54.042142 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi Jul 01 04:04:54.042142 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 04:04:54.042142 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 04:04:54.042142 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 04:04:54.042142 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 01 04:04:54.042142 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 01 04:04:54.043317 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 01 04:04:54.043317 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi Jul 01 04:04:54.043317 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-9b089d93-ab54-4755-8744-5448770dd5ff tempest-VolumesNegativeTest-21800228 tempest-VolumesNegativeTest-21800228-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=118712) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 04:04:54.050956 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-9b089d93-ab54-4755-8744-5448770dd5ff tempest-VolumesNegativeTest-21800228 tempest-VolumesNegativeTest-21800228-project] 10.222.0.20 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.470698 Jul 01 04:04:54.050956 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 29/52] 10.222.0.20 () {60 vars in 1155 bytes} [Fri Jul 1 04:04:53 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 473 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 01 04:04:54.076738 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-0b3e0704-892b-480f-bd31-dfa09fcab3fc tempest-VolumesNegativeTest-21800228 tempest-VolumesNegativeTest-21800228-project] Action: 'create', calling method: .version_select at 0x7f99a266e5e0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-124635277", "metadata": {"Type": "work"}}} {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 04:04:54.076738 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-0b3e0704-892b-480f-bd31-dfa09fcab3fc tempest-VolumesNegativeTest-21800228 tempest-VolumesNegativeTest-21800228-project] Request method failure captured: Jul 01 04:04:54.076738 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 01 04:04:54.076738 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: Accept: application/json Jul 01 04:04:54.076738 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: Accept-Encoding: identity Jul 01 04:04:54.076738 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: Connection: close Jul 01 04:04:54.076738 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: Content-Length: 119 Jul 01 04:04:54.076738 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: Content-Type: application/json Jul 01 04:04:54.076738 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: Host: 10.222.0.20 Jul 01 04:04:54.076738 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: Openstack-System-Scope: None Jul 01 04:04:54.076738 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: User-Agent: python-urllib3/1.26.9 Jul 01 04:04:54.076738 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Auth-Token: gAAAAABivnJlz94J85LLOQzbnf4Rl5v7XqbvfXaepfTAoqGsZpgf_fCpR6XNyHGfO_MUpasOaGlvarrA1nq6ITA7fgjlffrE6PUx5tBExMti4gC4ucR9sX0_36G7lM8LRWp_XcATMIXyHfgrqYEPI2ylQIWmK1dHLtTtTxaLqT1-4aGoHW2rIhE Jul 01 04:04:54.076738 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Domain-Id: None Jul 01 04:04:54.076738 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Domain-Name: None Jul 01 04:04:54.076738 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Identity-Status: Confirmed Jul 01 04:04:54.076738 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Is-Admin-Project: True Jul 01 04:04:54.076738 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Project-Domain-Id: default Jul 01 04:04:54.076738 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Project-Domain-Name: Default Jul 01 04:04:54.076738 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Project-Id: c79c8683f6614a9a9d883be0553d6b7e Jul 01 04:04:54.076738 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Project-Name: tempest-VolumesNegativeTest-21800228 Jul 01 04:04:54.076738 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Role: reader,member Jul 01 04:04:54.076738 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Roles: reader,member Jul 01 04:04:54.078822 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/c79c8683f6614a9a9d883be0553d6b7e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_c79c8683f6614a9a9d883be0553d6b7e", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c79c8683f6614a9a9d883be0553d6b7e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c79c8683f6614a9a9d883be0553d6b7e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}] Jul 01 04:04:54.078822 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Tenant: tempest-VolumesNegativeTest-21800228 Jul 01 04:04:54.078822 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Tenant-Id: c79c8683f6614a9a9d883be0553d6b7e Jul 01 04:04:54.078822 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Tenant-Name: tempest-VolumesNegativeTest-21800228 Jul 01 04:04:54.078822 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-User: tempest-VolumesNegativeTest-21800228-project Jul 01 04:04:54.078822 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-User-Domain-Id: default Jul 01 04:04:54.078822 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-User-Domain-Name: Default Jul 01 04:04:54.078822 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-User-Id: 9abd4bb809fa40689e8b2ad77b936a0f Jul 01 04:04:54.078822 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-User-Name: tempest-VolumesNegativeTest-21800228-project Jul 01 04:04:54.078822 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: Jul 01 04:04:54.078822 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-124635277", "metadata": {"Type": "work"}}} Jul 01 04:04:54.078822 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: method: Jul 01 04:04:54.078822 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 01 04:04:54.080840 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-124635277', 'metadata': {'Type': 'work'}}}} Jul 01 04:04:54.080840 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 04:04:54.080840 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 04:04:54.080840 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 01 04:04:54.080840 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 01 04:04:54.080840 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 01 04:04:54.080840 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi raise error Jul 01 04:04:54.080840 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jul 01 04:04:54.080840 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi Jul 01 04:04:54.080840 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jul 01 04:04:54.080840 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 01 04:04:54.080840 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi Jul 01 04:04:54.080840 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 01 04:04:54.080840 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi '0' Jul 01 04:04:54.080840 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi Jul 01 04:04:54.080840 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 04:04:54.080840 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi Jul 01 04:04:54.080840 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 04:04:54.080840 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 04:04:54.080840 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 04:04:54.080840 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 04:04:54.080840 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 04:04:54.082371 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 01 04:04:54.082371 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 01 04:04:54.082371 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 04:04:54.082371 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 04:04:54.082371 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 01 04:04:54.082371 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 01 04:04:54.082371 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 01 04:04:54.082371 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 01 04:04:54.082371 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 01 04:04:54.082371 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 01 04:04:54.082371 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 01 04:04:54.082371 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi Jul 01 04:04:54.082371 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 04:04:54.082371 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi Jul 01 04:04:54.082371 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 04:04:54.082371 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 04:04:54.082371 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 04:04:54.082371 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 01 04:04:54.082371 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 01 04:04:54.083684 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 01 04:04:54.083684 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi Jul 01 04:04:54.085873 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-0373e7e7-bd13-4d44-95e5-ef2d0331c3e0 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:04:54.087990 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-0b3e0704-892b-480f-bd31-dfa09fcab3fc tempest-VolumesNegativeTest-21800228 tempest-VolumesNegativeTest-21800228-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=118712) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 04:04:54.095628 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-0373e7e7-bd13-4d44-95e5-ef2d0331c3e0 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:04:54.097154 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-0b3e0704-892b-480f-bd31-dfa09fcab3fc tempest-VolumesNegativeTest-21800228 tempest-VolumesNegativeTest-21800228-project] 10.222.0.20 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.037992 Jul 01 04:04:54.102807 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 30/53] 10.222.0.20 () {60 vars in 1155 bytes} [Fri Jul 1 04:04:54 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 44 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 01 04:04:54.110421 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-72ee7f5b-21d1-47bd-8b10-cd99d8ef6b28 tempest-VolumesNegativeTest-21800228 tempest-VolumesNegativeTest-21800228-project] Action: 'create', calling method: .version_select at 0x7f99a151b820>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-784843165", "metadata": {"Type": "work"}}} {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 04:04:54.116411 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-0373e7e7-bd13-4d44-95e5-ef2d0331c3e0 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:04:54.118647 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-0373e7e7-bd13-4d44-95e5-ef2d0331c3e0 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] 10.222.0.20 "GET /compute/v2.1/servers/b904f233-887c-4c96-a2d2-f7f415ad852f" status: 200 len: 1282 microversion: 2.20 time: 0.166957 Jul 01 04:04:54.119855 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 24/54] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Jul 1 04:04:53 2022] GET /compute/v2.1/servers/b904f233-887c-4c96-a2d2-f7f415ad852f => generated 1282 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 04:04:54.133959 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-72ee7f5b-21d1-47bd-8b10-cd99d8ef6b28 tempest-VolumesNegativeTest-21800228 tempest-VolumesNegativeTest-21800228-project] Request method failure captured: Jul 01 04:04:54.133959 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 01 04:04:54.133959 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: Accept: application/json Jul 01 04:04:54.133959 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: Accept-Encoding: identity Jul 01 04:04:54.133959 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: Connection: close Jul 01 04:04:54.133959 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: Content-Length: 118 Jul 01 04:04:54.133959 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: Content-Type: application/json Jul 01 04:04:54.133959 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: Host: 10.222.0.20 Jul 01 04:04:54.133959 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: Openstack-System-Scope: None Jul 01 04:04:54.133959 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: User-Agent: python-urllib3/1.26.9 Jul 01 04:04:54.133959 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Auth-Token: gAAAAABivnJlz94J85LLOQzbnf4Rl5v7XqbvfXaepfTAoqGsZpgf_fCpR6XNyHGfO_MUpasOaGlvarrA1nq6ITA7fgjlffrE6PUx5tBExMti4gC4ucR9sX0_36G7lM8LRWp_XcATMIXyHfgrqYEPI2ylQIWmK1dHLtTtTxaLqT1-4aGoHW2rIhE Jul 01 04:04:54.133959 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Domain-Id: None Jul 01 04:04:54.133959 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Domain-Name: None Jul 01 04:04:54.133959 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Identity-Status: Confirmed Jul 01 04:04:54.133959 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Is-Admin-Project: True Jul 01 04:04:54.133959 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Project-Domain-Id: default Jul 01 04:04:54.133959 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Project-Domain-Name: Default Jul 01 04:04:54.133959 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Project-Id: c79c8683f6614a9a9d883be0553d6b7e Jul 01 04:04:54.133959 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Project-Name: tempest-VolumesNegativeTest-21800228 Jul 01 04:04:54.133959 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Role: reader,member Jul 01 04:04:54.133959 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Roles: reader,member Jul 01 04:04:54.135600 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/c79c8683f6614a9a9d883be0553d6b7e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_c79c8683f6614a9a9d883be0553d6b7e", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c79c8683f6614a9a9d883be0553d6b7e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c79c8683f6614a9a9d883be0553d6b7e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}] Jul 01 04:04:54.135600 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Tenant: tempest-VolumesNegativeTest-21800228 Jul 01 04:04:54.135600 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Tenant-Id: c79c8683f6614a9a9d883be0553d6b7e Jul 01 04:04:54.135600 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Tenant-Name: tempest-VolumesNegativeTest-21800228 Jul 01 04:04:54.135600 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-User: tempest-VolumesNegativeTest-21800228-project Jul 01 04:04:54.135600 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-User-Domain-Id: default Jul 01 04:04:54.135600 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-User-Domain-Name: Default Jul 01 04:04:54.135600 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-User-Id: 9abd4bb809fa40689e8b2ad77b936a0f Jul 01 04:04:54.135600 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-User-Name: tempest-VolumesNegativeTest-21800228-project Jul 01 04:04:54.135600 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: Jul 01 04:04:54.135600 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-784843165", "metadata": {"Type": "work"}}} Jul 01 04:04:54.135600 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: method: Jul 01 04:04:54.135600 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 01 04:04:54.136455 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-784843165', 'metadata': {'Type': 'work'}}}} Jul 01 04:04:54.136455 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 04:04:54.136455 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 04:04:54.136455 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 01 04:04:54.136455 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 01 04:04:54.136455 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 01 04:04:54.136455 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi raise error Jul 01 04:04:54.136455 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jul 01 04:04:54.136455 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi Jul 01 04:04:54.136455 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 01 04:04:54.136455 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 01 04:04:54.136455 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi Jul 01 04:04:54.136455 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 01 04:04:54.136455 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi '' Jul 01 04:04:54.136455 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi Jul 01 04:04:54.136455 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 04:04:54.136455 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi Jul 01 04:04:54.136455 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 04:04:54.136455 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 04:04:54.136455 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 04:04:54.136455 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 04:04:54.136455 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 04:04:54.137774 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 01 04:04:54.137774 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 01 04:04:54.137774 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 04:04:54.137774 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 04:04:54.137774 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 01 04:04:54.137774 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 01 04:04:54.137774 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 01 04:04:54.137774 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 01 04:04:54.137774 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 01 04:04:54.137774 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 01 04:04:54.137774 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 01 04:04:54.137774 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi Jul 01 04:04:54.137774 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 04:04:54.137774 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi Jul 01 04:04:54.137774 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 04:04:54.137774 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 04:04:54.137774 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 04:04:54.137774 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 01 04:04:54.137774 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 01 04:04:54.138880 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 01 04:04:54.138880 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi Jul 01 04:04:54.138880 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-72ee7f5b-21d1-47bd-8b10-cd99d8ef6b28 tempest-VolumesNegativeTest-21800228 tempest-VolumesNegativeTest-21800228-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=118712) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 04:04:54.138880 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-72ee7f5b-21d1-47bd-8b10-cd99d8ef6b28 tempest-VolumesNegativeTest-21800228 tempest-VolumesNegativeTest-21800228-project] 10.222.0.20 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.024672 Jul 01 04:04:54.138880 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 31/55] 10.222.0.20 () {60 vars in 1155 bytes} [Fri Jul 1 04:04:54 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 28 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 01 04:04:54.142727 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-77ba48c9-da40-4011-b3e2-bd5d31f9bc6d tempest-DeleteServersTestJSON-285930608 tempest-DeleteServersTestJSON-285930608-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:04:54.144778 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-77ba48c9-da40-4011-b3e2-bd5d31f9bc6d tempest-DeleteServersTestJSON-285930608 tempest-DeleteServersTestJSON-285930608-project] [instance: 3858eceb-54a4-4bac-beef-8acd0afafba7] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:04:54.160986 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-77ba48c9-da40-4011-b3e2-bd5d31f9bc6d tempest-DeleteServersTestJSON-285930608 tempest-DeleteServersTestJSON-285930608-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:04:54.161709 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-77ba48c9-da40-4011-b3e2-bd5d31f9bc6d tempest-DeleteServersTestJSON-285930608 tempest-DeleteServersTestJSON-285930608-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:04:54.162742 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-77ba48c9-da40-4011-b3e2-bd5d31f9bc6d tempest-DeleteServersTestJSON-285930608 tempest-DeleteServersTestJSON-285930608-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:04:54.164883 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-77ba48c9-da40-4011-b3e2-bd5d31f9bc6d tempest-DeleteServersTestJSON-285930608 tempest-DeleteServersTestJSON-285930608-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:04:54.168382 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-6830126b-1834-44cd-baa4-f097ca447029 tempest-VolumesNegativeTest-21800228 tempest-VolumesNegativeTest-21800228-project] Calling method '.version_select at 0x7f99a146a430>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:04:54.220639 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.wsgi [None req-6830126b-1834-44cd-baa4-f097ca447029 tempest-VolumesNegativeTest-21800228 tempest-VolumesNegativeTest-21800228-project] HTTP exception thrown: Volume tempest-invalid-174734247 could not be found. Jul 01 04:04:54.224940 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-6830126b-1834-44cd-baa4-f097ca447029 tempest-VolumesNegativeTest-21800228 tempest-VolumesNegativeTest-21800228-project] Request method failure captured: Jul 01 04:04:54.224940 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-174734247 HTTP/1.1 Jul 01 04:04:54.224940 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: Accept: application/json Jul 01 04:04:54.224940 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: Accept-Encoding: identity Jul 01 04:04:54.224940 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: Connection: close Jul 01 04:04:54.224940 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: Content-Length: 0 Jul 01 04:04:54.224940 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: Content-Type: application/json Jul 01 04:04:54.224940 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: Host: 10.222.0.20 Jul 01 04:04:54.224940 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: Openstack-System-Scope: None Jul 01 04:04:54.224940 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: User-Agent: python-urllib3/1.26.9 Jul 01 04:04:54.224940 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Auth-Token: gAAAAABivnJlz94J85LLOQzbnf4Rl5v7XqbvfXaepfTAoqGsZpgf_fCpR6XNyHGfO_MUpasOaGlvarrA1nq6ITA7fgjlffrE6PUx5tBExMti4gC4ucR9sX0_36G7lM8LRWp_XcATMIXyHfgrqYEPI2ylQIWmK1dHLtTtTxaLqT1-4aGoHW2rIhE Jul 01 04:04:54.224940 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Domain-Id: None Jul 01 04:04:54.224940 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Domain-Name: None Jul 01 04:04:54.224940 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Identity-Status: Confirmed Jul 01 04:04:54.224940 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Is-Admin-Project: True Jul 01 04:04:54.224940 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Project-Domain-Id: default Jul 01 04:04:54.224940 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Project-Domain-Name: Default Jul 01 04:04:54.224940 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Project-Id: c79c8683f6614a9a9d883be0553d6b7e Jul 01 04:04:54.224940 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Project-Name: tempest-VolumesNegativeTest-21800228 Jul 01 04:04:54.224940 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Role: reader,member Jul 01 04:04:54.224940 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Roles: reader,member Jul 01 04:04:54.232398 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/c79c8683f6614a9a9d883be0553d6b7e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_c79c8683f6614a9a9d883be0553d6b7e", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c79c8683f6614a9a9d883be0553d6b7e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c79c8683f6614a9a9d883be0553d6b7e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}] Jul 01 04:04:54.232398 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Tenant: tempest-VolumesNegativeTest-21800228 Jul 01 04:04:54.232398 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Tenant-Id: c79c8683f6614a9a9d883be0553d6b7e Jul 01 04:04:54.232398 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Tenant-Name: tempest-VolumesNegativeTest-21800228 Jul 01 04:04:54.232398 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-User: tempest-VolumesNegativeTest-21800228-project Jul 01 04:04:54.232398 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-User-Domain-Id: default Jul 01 04:04:54.232398 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-User-Domain-Name: Default Jul 01 04:04:54.232398 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-User-Id: 9abd4bb809fa40689e8b2ad77b936a0f Jul 01 04:04:54.232398 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-User-Name: tempest-VolumesNegativeTest-21800228-project Jul 01 04:04:54.232398 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: method: Jul 01 04:04:54.232398 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: exception: Volume tempest-invalid-174734247 could not be found. Jul 01 04:04:54.232398 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: action_args: {'id': 'tempest-invalid-174734247'} Jul 01 04:04:54.232398 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 04:04:54.232398 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 04:04:54.233182 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 01 04:04:54.233182 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 01 04:04:54.233182 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 01 04:04:54.233182 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 01 04:04:54.233182 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 01 04:04:54.233182 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 01 04:04:54.233182 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 01 04:04:54.233182 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 01 04:04:54.233182 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 01 04:04:54.233182 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 01 04:04:54.233182 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 01 04:04:54.233182 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 01 04:04:54.233182 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 01 04:04:54.233182 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 01 04:04:54.233182 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-174734247 could not be found. (HTTP 404) (Request-ID: req-f27db800-9266-4140-a8c2-bbf92e6fe690) Jul 01 04:04:54.233182 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi Jul 01 04:04:54.233182 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 04:04:54.233182 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi Jul 01 04:04:54.233182 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 04:04:54.234094 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 01 04:04:54.234094 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 01 04:04:54.234094 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 01 04:04:54.234094 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 01 04:04:54.234094 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 01 04:04:54.234094 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 01 04:04:54.234094 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 01 04:04:54.234094 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 01 04:04:54.234094 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 01 04:04:54.234094 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 01 04:04:54.234094 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 01 04:04:54.234094 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 01 04:04:54.234094 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 01 04:04:54.234094 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 01 04:04:54.234094 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 01 04:04:54.234094 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 01 04:04:54.234094 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 01 04:04:54.234094 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 01 04:04:54.234965 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 01 04:04:54.234965 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 01 04:04:54.234965 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 01 04:04:54.234965 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 01 04:04:54.234965 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-174734247 could not be found. Jul 01 04:04:54.234965 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi Jul 01 04:04:54.234965 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 04:04:54.234965 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi Jul 01 04:04:54.234965 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 04:04:54.234965 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 04:04:54.234965 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 04:04:54.234965 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 04:04:54.234965 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 04:04:54.234965 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 01 04:04:54.234965 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 01 04:04:54.234965 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 04:04:54.234965 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 04:04:54.234965 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 01 04:04:54.234965 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 04:04:54.234965 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-174734247 could not be found. Jul 01 04:04:54.236040 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi Jul 01 04:04:54.236040 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 04:04:54.236040 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi Jul 01 04:04:54.236040 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 04:04:54.236040 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 04:04:54.236040 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 04:04:54.236040 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 04:04:54.236040 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 04:04:54.236040 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-174734247 could not be found. Jul 01 04:04:54.236040 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi Jul 01 04:04:54.236040 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-6830126b-1834-44cd-baa4-f097ca447029 tempest-VolumesNegativeTest-21800228 tempest-VolumesNegativeTest-21800228-project] Returning 404 to user: Volume tempest-invalid-174734247 could not be found. {{(pid=118712) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 04:04:54.236040 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-6830126b-1834-44cd-baa4-f097ca447029 tempest-VolumesNegativeTest-21800228 tempest-VolumesNegativeTest-21800228-project] 10.222.0.20 "DELETE /compute/v2.1/os-volumes/tempest-invalid-174734247" status: 404 len: 98 microversion: 2.1 time: 0.073543 Jul 01 04:04:54.236040 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 32/56] 10.222.0.20 () {58 vars in 1214 bytes} [Fri Jul 1 04:04:54 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-174734247 => generated 98 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Jul 01 04:04:54.246628 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-5e44a541-cd71-44a1-a4fb-33532f32f3bc tempest-VolumesNegativeTest-21800228 tempest-VolumesNegativeTest-21800228-project] 10.222.0.20 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.008477 Jul 01 04:04:54.255135 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 33/57] 10.222.0.20 () {58 vars in 1139 bytes} [Fri Jul 1 04:04:54 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 12 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 01 04:04:54.265226 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-31c925a0-9e5a-4bdb-9f3a-b09c8e873ec6 tempest-VolumesNegativeTest-21800228 tempest-VolumesNegativeTest-21800228-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.007634 Jul 01 04:04:54.267607 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 34/58] 10.222.0.20 () {58 vars in 1136 bytes} [Fri Jul 1 04:04:54 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 12 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 01 04:04:54.293213 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-77ba48c9-da40-4011-b3e2-bd5d31f9bc6d tempest-DeleteServersTestJSON-285930608 tempest-DeleteServersTestJSON-285930608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab2da92b7e94592b80ef3d7852f51ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb56c390ed7649479455d6dc3904deb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:04:54.330473 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-77ba48c9-da40-4011-b3e2-bd5d31f9bc6d tempest-DeleteServersTestJSON-285930608 tempest-DeleteServersTestJSON-285930608-project] 10.222.0.20 "GET /compute/v2.1/servers/3858eceb-54a4-4bac-beef-8acd0afafba7" status: 200 len: 1267 microversion: 2.1 time: 0.200299 Jul 01 04:04:54.344233 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 25/59] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:04:54 2022] GET /compute/v2.1/servers/3858eceb-54a4-4bac-beef-8acd0afafba7 => generated 1267 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:04:54.358060 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-aee0fb2c-3c9b-44be-beb1-1702e53a54df tempest-VolumesNegativeTest-21800228 tempest-VolumesNegativeTest-21800228-project] Calling method '.version_select at 0x7f99a149c790>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:04:54.420908 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.wsgi [None req-aee0fb2c-3c9b-44be-beb1-1702e53a54df tempest-VolumesNegativeTest-21800228 tempest-VolumesNegativeTest-21800228-project] HTTP exception thrown: Volume e5c80523-7868-4956-a3fd-7e2c5e2066dd could not be found. Jul 01 04:04:54.423990 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-aee0fb2c-3c9b-44be-beb1-1702e53a54df tempest-VolumesNegativeTest-21800228 tempest-VolumesNegativeTest-21800228-project] Request method failure captured: Jul 01 04:04:54.423990 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: request: DELETE /compute/v2.1/os-volumes/e5c80523-7868-4956-a3fd-7e2c5e2066dd HTTP/1.1 Jul 01 04:04:54.423990 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: Accept: application/json Jul 01 04:04:54.423990 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: Accept-Encoding: identity Jul 01 04:04:54.423990 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: Connection: close Jul 01 04:04:54.423990 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: Content-Length: 0 Jul 01 04:04:54.423990 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: Content-Type: application/json Jul 01 04:04:54.423990 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: Host: 10.222.0.20 Jul 01 04:04:54.423990 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: Openstack-System-Scope: None Jul 01 04:04:54.423990 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: User-Agent: python-urllib3/1.26.9 Jul 01 04:04:54.423990 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Auth-Token: gAAAAABivnJlz94J85LLOQzbnf4Rl5v7XqbvfXaepfTAoqGsZpgf_fCpR6XNyHGfO_MUpasOaGlvarrA1nq6ITA7fgjlffrE6PUx5tBExMti4gC4ucR9sX0_36G7lM8LRWp_XcATMIXyHfgrqYEPI2ylQIWmK1dHLtTtTxaLqT1-4aGoHW2rIhE Jul 01 04:04:54.423990 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Domain-Id: None Jul 01 04:04:54.423990 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Domain-Name: None Jul 01 04:04:54.423990 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Identity-Status: Confirmed Jul 01 04:04:54.423990 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Is-Admin-Project: True Jul 01 04:04:54.423990 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Project-Domain-Id: default Jul 01 04:04:54.423990 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Project-Domain-Name: Default Jul 01 04:04:54.423990 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Project-Id: c79c8683f6614a9a9d883be0553d6b7e Jul 01 04:04:54.423990 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Project-Name: tempest-VolumesNegativeTest-21800228 Jul 01 04:04:54.423990 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Role: reader,member Jul 01 04:04:54.423990 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Roles: reader,member Jul 01 04:04:54.429996 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/c79c8683f6614a9a9d883be0553d6b7e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_c79c8683f6614a9a9d883be0553d6b7e", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c79c8683f6614a9a9d883be0553d6b7e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c79c8683f6614a9a9d883be0553d6b7e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}] Jul 01 04:04:54.429996 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Tenant: tempest-VolumesNegativeTest-21800228 Jul 01 04:04:54.429996 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Tenant-Id: c79c8683f6614a9a9d883be0553d6b7e Jul 01 04:04:54.429996 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Tenant-Name: tempest-VolumesNegativeTest-21800228 Jul 01 04:04:54.429996 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-User: tempest-VolumesNegativeTest-21800228-project Jul 01 04:04:54.429996 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-User-Domain-Id: default Jul 01 04:04:54.429996 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-User-Domain-Name: Default Jul 01 04:04:54.429996 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-User-Id: 9abd4bb809fa40689e8b2ad77b936a0f Jul 01 04:04:54.429996 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-User-Name: tempest-VolumesNegativeTest-21800228-project Jul 01 04:04:54.429996 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: method: Jul 01 04:04:54.429996 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: exception: Volume e5c80523-7868-4956-a3fd-7e2c5e2066dd could not be found. Jul 01 04:04:54.429996 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: action_args: {'id': 'e5c80523-7868-4956-a3fd-7e2c5e2066dd'} Jul 01 04:04:54.429996 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 04:04:54.430634 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 04:04:54.430634 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 01 04:04:54.430634 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 01 04:04:54.430634 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 01 04:04:54.430634 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 01 04:04:54.430634 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 01 04:04:54.430634 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 01 04:04:54.430634 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 01 04:04:54.430634 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 01 04:04:54.430634 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 01 04:04:54.430634 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 01 04:04:54.430634 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 01 04:04:54.430634 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 01 04:04:54.430634 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 01 04:04:54.430634 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 01 04:04:54.430634 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume e5c80523-7868-4956-a3fd-7e2c5e2066dd could not be found. (HTTP 404) (Request-ID: req-e7243335-153f-4b28-99f4-bd2212c00f6c) Jul 01 04:04:54.430634 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi Jul 01 04:04:54.430634 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 04:04:54.430634 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi Jul 01 04:04:54.431602 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 04:04:54.431602 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 01 04:04:54.431602 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 01 04:04:54.431602 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 01 04:04:54.431602 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 01 04:04:54.431602 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 01 04:04:54.431602 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 01 04:04:54.431602 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 01 04:04:54.431602 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 01 04:04:54.431602 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 01 04:04:54.431602 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 01 04:04:54.431602 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 01 04:04:54.431602 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 01 04:04:54.431602 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 01 04:04:54.431602 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 01 04:04:54.431602 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 01 04:04:54.431602 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 01 04:04:54.431602 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 01 04:04:54.431602 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 01 04:04:54.432611 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 01 04:04:54.432611 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 01 04:04:54.432611 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 01 04:04:54.432611 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 01 04:04:54.432611 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume e5c80523-7868-4956-a3fd-7e2c5e2066dd could not be found. Jul 01 04:04:54.432611 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi Jul 01 04:04:54.432611 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 04:04:54.432611 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi Jul 01 04:04:54.432611 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 04:04:54.432611 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 04:04:54.432611 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 04:04:54.432611 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 04:04:54.432611 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 04:04:54.432611 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 01 04:04:54.432611 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 01 04:04:54.432611 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 04:04:54.432611 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 04:04:54.432611 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 01 04:04:54.432611 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 04:04:54.433644 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume e5c80523-7868-4956-a3fd-7e2c5e2066dd could not be found. Jul 01 04:04:54.433644 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi Jul 01 04:04:54.433644 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 04:04:54.433644 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi Jul 01 04:04:54.433644 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 04:04:54.433644 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 04:04:54.433644 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 04:04:54.433644 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 04:04:54.433644 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 04:04:54.433644 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume e5c80523-7868-4956-a3fd-7e2c5e2066dd could not be found. Jul 01 04:04:54.433644 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi Jul 01 04:04:54.433644 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-aee0fb2c-3c9b-44be-beb1-1702e53a54df tempest-VolumesNegativeTest-21800228 tempest-VolumesNegativeTest-21800228-project] Returning 404 to user: Volume e5c80523-7868-4956-a3fd-7e2c5e2066dd could not be found. {{(pid=118712) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 04:04:54.433644 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-aee0fb2c-3c9b-44be-beb1-1702e53a54df tempest-VolumesNegativeTest-21800228 tempest-VolumesNegativeTest-21800228-project] 10.222.0.20 "DELETE /compute/v2.1/os-volumes/e5c80523-7868-4956-a3fd-7e2c5e2066dd" status: 404 len: 109 microversion: 2.1 time: 0.138358 Jul 01 04:04:54.433644 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 35/60] 10.222.0.20 () {58 vars in 1247 bytes} [Fri Jul 1 04:04:54 2022] DELETE /compute/v2.1/os-volumes/e5c80523-7868-4956-a3fd-7e2c5e2066dd => generated 109 bytes in 142 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 04:04:54.440199 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-34651e29-74f0-4546-84e1-782f730ec27b tempest-VolumesNegativeTest-21800228 tempest-VolumesNegativeTest-21800228-project] Calling method '.version_select at 0x7f99a0d493a0>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:04:54.520515 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.wsgi [None req-34651e29-74f0-4546-84e1-782f730ec27b tempest-VolumesNegativeTest-21800228 tempest-VolumesNegativeTest-21800228-project] HTTP exception thrown: Volume fbc0a9d2-106c-487f-a405-a42373beebd3 could not be found. Jul 01 04:04:54.525820 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-34651e29-74f0-4546-84e1-782f730ec27b tempest-VolumesNegativeTest-21800228 tempest-VolumesNegativeTest-21800228-project] Request method failure captured: Jul 01 04:04:54.525820 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: request: GET /compute/v2.1/os-volumes/fbc0a9d2-106c-487f-a405-a42373beebd3 HTTP/1.1 Jul 01 04:04:54.525820 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: Accept: application/json Jul 01 04:04:54.525820 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: Accept-Encoding: identity Jul 01 04:04:54.525820 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: Connection: close Jul 01 04:04:54.525820 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: Content-Length: 0 Jul 01 04:04:54.525820 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: Content-Type: application/json Jul 01 04:04:54.525820 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: Host: 10.222.0.20 Jul 01 04:04:54.525820 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: Openstack-System-Scope: None Jul 01 04:04:54.525820 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: User-Agent: python-urllib3/1.26.9 Jul 01 04:04:54.525820 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-Auth-Token: gAAAAABivnJlz94J85LLOQzbnf4Rl5v7XqbvfXaepfTAoqGsZpgf_fCpR6XNyHGfO_MUpasOaGlvarrA1nq6ITA7fgjlffrE6PUx5tBExMti4gC4ucR9sX0_36G7lM8LRWp_XcATMIXyHfgrqYEPI2ylQIWmK1dHLtTtTxaLqT1-4aGoHW2rIhE Jul 01 04:04:54.525820 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-Domain-Id: None Jul 01 04:04:54.525820 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-Domain-Name: None Jul 01 04:04:54.525820 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-Identity-Status: Confirmed Jul 01 04:04:54.525820 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-Is-Admin-Project: True Jul 01 04:04:54.525820 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-Project-Domain-Id: default Jul 01 04:04:54.525820 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-Project-Domain-Name: Default Jul 01 04:04:54.525820 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-Project-Id: c79c8683f6614a9a9d883be0553d6b7e Jul 01 04:04:54.525820 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-Project-Name: tempest-VolumesNegativeTest-21800228 Jul 01 04:04:54.525820 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-Role: reader,member Jul 01 04:04:54.525820 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-Roles: reader,member Jul 01 04:04:54.527726 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/c79c8683f6614a9a9d883be0553d6b7e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_c79c8683f6614a9a9d883be0553d6b7e", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c79c8683f6614a9a9d883be0553d6b7e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c79c8683f6614a9a9d883be0553d6b7e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}] Jul 01 04:04:54.527726 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-Tenant: tempest-VolumesNegativeTest-21800228 Jul 01 04:04:54.527726 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-Tenant-Id: c79c8683f6614a9a9d883be0553d6b7e Jul 01 04:04:54.527726 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-Tenant-Name: tempest-VolumesNegativeTest-21800228 Jul 01 04:04:54.527726 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-User: tempest-VolumesNegativeTest-21800228-project Jul 01 04:04:54.527726 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-User-Domain-Id: default Jul 01 04:04:54.527726 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-User-Domain-Name: Default Jul 01 04:04:54.527726 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-User-Id: 9abd4bb809fa40689e8b2ad77b936a0f Jul 01 04:04:54.527726 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-User-Name: tempest-VolumesNegativeTest-21800228-project Jul 01 04:04:54.527726 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: method: Jul 01 04:04:54.527726 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: exception: Volume fbc0a9d2-106c-487f-a405-a42373beebd3 could not be found. Jul 01 04:04:54.527726 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: action_args: {'id': 'fbc0a9d2-106c-487f-a405-a42373beebd3'} Jul 01 04:04:54.527726 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 04:04:54.528499 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 04:04:54.528499 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 01 04:04:54.528499 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 01 04:04:54.528499 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 01 04:04:54.528499 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 01 04:04:54.528499 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 01 04:04:54.528499 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 01 04:04:54.528499 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 01 04:04:54.528499 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 01 04:04:54.528499 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 01 04:04:54.528499 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 01 04:04:54.528499 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 01 04:04:54.528499 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 01 04:04:54.528499 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 01 04:04:54.528499 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 01 04:04:54.528499 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume fbc0a9d2-106c-487f-a405-a42373beebd3 could not be found. (HTTP 404) (Request-ID: req-37cac728-90e2-45f8-a15b-db5f66d1f106) Jul 01 04:04:54.528499 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi Jul 01 04:04:54.528499 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 04:04:54.528499 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi Jul 01 04:04:54.529497 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 04:04:54.529497 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 01 04:04:54.529497 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 01 04:04:54.529497 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 01 04:04:54.529497 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 01 04:04:54.529497 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 01 04:04:54.529497 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 01 04:04:54.529497 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 01 04:04:54.529497 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 01 04:04:54.529497 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 01 04:04:54.529497 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 01 04:04:54.529497 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 01 04:04:54.529497 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 01 04:04:54.529497 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 01 04:04:54.529497 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 01 04:04:54.529497 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 01 04:04:54.529497 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 01 04:04:54.529497 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 01 04:04:54.529497 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 01 04:04:54.530426 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 01 04:04:54.530426 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 01 04:04:54.530426 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 01 04:04:54.530426 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 01 04:04:54.530426 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume fbc0a9d2-106c-487f-a405-a42373beebd3 could not be found. Jul 01 04:04:54.530426 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi Jul 01 04:04:54.530426 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 04:04:54.530426 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi Jul 01 04:04:54.530426 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 04:04:54.530426 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 04:04:54.530426 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 04:04:54.530426 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 04:04:54.530426 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 04:04:54.530426 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 01 04:04:54.530426 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 01 04:04:54.530426 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 04:04:54.530426 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 04:04:54.530426 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 01 04:04:54.530426 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 04:04:54.531372 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume fbc0a9d2-106c-487f-a405-a42373beebd3 could not be found. Jul 01 04:04:54.531372 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi Jul 01 04:04:54.531372 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 04:04:54.531372 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi Jul 01 04:04:54.531372 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 04:04:54.531372 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 04:04:54.531372 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 04:04:54.531372 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 04:04:54.531372 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 04:04:54.531372 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume fbc0a9d2-106c-487f-a405-a42373beebd3 could not be found. Jul 01 04:04:54.531372 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi Jul 01 04:04:54.531372 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-34651e29-74f0-4546-84e1-782f730ec27b tempest-VolumesNegativeTest-21800228 tempest-VolumesNegativeTest-21800228-project] Returning 404 to user: Volume fbc0a9d2-106c-487f-a405-a42373beebd3 could not be found. {{(pid=118711) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 04:04:54.531372 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-34651e29-74f0-4546-84e1-782f730ec27b tempest-VolumesNegativeTest-21800228 tempest-VolumesNegativeTest-21800228-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/fbc0a9d2-106c-487f-a405-a42373beebd3" status: 404 len: 109 microversion: 2.1 time: 0.095342 Jul 01 04:04:54.539803 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 26/61] 10.222.0.20 () {58 vars in 1244 bytes} [Fri Jul 1 04:04:54 2022] GET /compute/v2.1/os-volumes/fbc0a9d2-106c-487f-a405-a42373beebd3 => generated 109 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 04:04:54.975694 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-a7ca9c33-f578-4515-a462-0795a1eaae83 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:04:54.976757 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-a7ca9c33-f578-4515-a462-0795a1eaae83 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] [instance: f0c5fb50-4991-45b2-803d-7bcfe51f7c34] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:04:54.991508 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-a7ca9c33-f578-4515-a462-0795a1eaae83 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:04:54.994418 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-a7ca9c33-f578-4515-a462-0795a1eaae83 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:04:54.996718 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-a7ca9c33-f578-4515-a462-0795a1eaae83 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:04:54.998050 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-a7ca9c33-f578-4515-a462-0795a1eaae83 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:04:55.173343 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-b61e6cb7-85c2-429e-b5a6-515fb9fed94d tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:04:55.174984 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-b61e6cb7-85c2-429e-b5a6-515fb9fed94d tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] [instance: b904f233-887c-4c96-a2d2-f7f415ad852f] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:04:55.339503 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-b61e6cb7-85c2-429e-b5a6-515fb9fed94d tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:04:55.405064 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-b61e6cb7-85c2-429e-b5a6-515fb9fed94d tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:04:55.409126 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-a7ca9c33-f578-4515-a462-0795a1eaae83 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8622ec5212c84d87b9b7c8f725012a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0143140d4f649478e36abcee284640c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:04:55.410533 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-b61e6cb7-85c2-429e-b5a6-515fb9fed94d tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:04:55.419136 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-b61e6cb7-85c2-429e-b5a6-515fb9fed94d tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] 10.222.0.20 "GET /compute/v2.1/servers/b904f233-887c-4c96-a2d2-f7f415ad852f" status: 200 len: 1282 microversion: 2.20 time: 0.250730 Jul 01 04:04:55.421801 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-a7ca9c33-f578-4515-a462-0795a1eaae83 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] 10.222.0.20 "GET /compute/v2.1/servers/f0c5fb50-4991-45b2-803d-7bcfe51f7c34" status: 200 len: 1289 microversion: 2.1 time: 0.451375 Jul 01 04:04:55.432703 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 36/62] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:04:54 2022] GET /compute/v2.1/servers/f0c5fb50-4991-45b2-803d-7bcfe51f7c34 => generated 1289 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:04:55.438904 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-e10183bf-2229-4ffe-b01d-75559fa7e8f3 tempest-DeleteServersTestJSON-285930608 tempest-DeleteServersTestJSON-285930608-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:04:55.443678 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 27/63] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Jul 1 04:04:55 2022] GET /compute/v2.1/servers/b904f233-887c-4c96-a2d2-f7f415ad852f => generated 1282 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 04:04:55.449574 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-e10183bf-2229-4ffe-b01d-75559fa7e8f3 tempest-DeleteServersTestJSON-285930608 tempest-DeleteServersTestJSON-285930608-project] [instance: 3858eceb-54a4-4bac-beef-8acd0afafba7] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:04:55.464070 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-e10183bf-2229-4ffe-b01d-75559fa7e8f3 tempest-DeleteServersTestJSON-285930608 tempest-DeleteServersTestJSON-285930608-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:04:55.465618 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-e10183bf-2229-4ffe-b01d-75559fa7e8f3 tempest-DeleteServersTestJSON-285930608 tempest-DeleteServersTestJSON-285930608-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:04:55.467544 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-e10183bf-2229-4ffe-b01d-75559fa7e8f3 tempest-DeleteServersTestJSON-285930608 tempest-DeleteServersTestJSON-285930608-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:04:55.468807 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-e10183bf-2229-4ffe-b01d-75559fa7e8f3 tempest-DeleteServersTestJSON-285930608 tempest-DeleteServersTestJSON-285930608-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:04:55.728583 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-e10183bf-2229-4ffe-b01d-75559fa7e8f3 tempest-DeleteServersTestJSON-285930608 tempest-DeleteServersTestJSON-285930608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab2da92b7e94592b80ef3d7852f51ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb56c390ed7649479455d6dc3904deb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:04:55.739709 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-e10183bf-2229-4ffe-b01d-75559fa7e8f3 tempest-DeleteServersTestJSON-285930608 tempest-DeleteServersTestJSON-285930608-project] 10.222.0.20 "GET /compute/v2.1/servers/3858eceb-54a4-4bac-beef-8acd0afafba7" status: 200 len: 1273 microversion: 2.1 time: 0.305392 Jul 01 04:04:55.740487 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 37/64] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:04:55 2022] GET /compute/v2.1/servers/3858eceb-54a4-4bac-beef-8acd0afafba7 => generated 1273 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:04:56.455662 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-b227943d-8ff5-4d49-b15e-a8cf2c99f415 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:04:56.460074 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-b227943d-8ff5-4d49-b15e-a8cf2c99f415 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] [instance: f0c5fb50-4991-45b2-803d-7bcfe51f7c34] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:04:56.466143 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-6a9af03d-686d-4a92-9f29-462d6a66fd69 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:04:56.468396 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-6a9af03d-686d-4a92-9f29-462d6a66fd69 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] [instance: b904f233-887c-4c96-a2d2-f7f415ad852f] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:04:56.481746 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-b227943d-8ff5-4d49-b15e-a8cf2c99f415 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:04:56.483391 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-b227943d-8ff5-4d49-b15e-a8cf2c99f415 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:04:56.486438 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-b227943d-8ff5-4d49-b15e-a8cf2c99f415 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:04:56.489395 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-b227943d-8ff5-4d49-b15e-a8cf2c99f415 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:04:56.519436 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-6a9af03d-686d-4a92-9f29-462d6a66fd69 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:04:56.520258 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-6a9af03d-686d-4a92-9f29-462d6a66fd69 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:04:56.522567 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-6a9af03d-686d-4a92-9f29-462d6a66fd69 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:04:56.523433 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-6a9af03d-686d-4a92-9f29-462d6a66fd69 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:04:56.777129 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-6a9af03d-686d-4a92-9f29-462d6a66fd69 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:04:56.781620 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-b227943d-8ff5-4d49-b15e-a8cf2c99f415 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8622ec5212c84d87b9b7c8f725012a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0143140d4f649478e36abcee284640c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:04:56.791158 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-b227943d-8ff5-4d49-b15e-a8cf2c99f415 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] 10.222.0.20 "GET /compute/v2.1/servers/f0c5fb50-4991-45b2-803d-7bcfe51f7c34" status: 200 len: 1277 microversion: 2.1 time: 0.353669 Jul 01 04:04:56.798171 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 28/65] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:04:56 2022] GET /compute/v2.1/servers/f0c5fb50-4991-45b2-803d-7bcfe51f7c34 => generated 1277 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:04:56.804231 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-d8986881-10a8-4d51-8b16-d7754060e501 tempest-DeleteServersTestJSON-285930608 tempest-DeleteServersTestJSON-285930608-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:04:56.805908 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-d8986881-10a8-4d51-8b16-d7754060e501 tempest-DeleteServersTestJSON-285930608 tempest-DeleteServersTestJSON-285930608-project] [instance: 3858eceb-54a4-4bac-beef-8acd0afafba7] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:04:56.809536 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-6a9af03d-686d-4a92-9f29-462d6a66fd69 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:04:56.817410 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-6a9af03d-686d-4a92-9f29-462d6a66fd69 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:04:56.817784 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-d8986881-10a8-4d51-8b16-d7754060e501 tempest-DeleteServersTestJSON-285930608 tempest-DeleteServersTestJSON-285930608-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:04:56.818537 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-d8986881-10a8-4d51-8b16-d7754060e501 tempest-DeleteServersTestJSON-285930608 tempest-DeleteServersTestJSON-285930608-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:04:56.819873 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-d8986881-10a8-4d51-8b16-d7754060e501 tempest-DeleteServersTestJSON-285930608 tempest-DeleteServersTestJSON-285930608-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:04:56.820613 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-d8986881-10a8-4d51-8b16-d7754060e501 tempest-DeleteServersTestJSON-285930608 tempest-DeleteServersTestJSON-285930608-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:04:56.840842 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-6a9af03d-686d-4a92-9f29-462d6a66fd69 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] 10.222.0.20 "GET /compute/v2.1/servers/b904f233-887c-4c96-a2d2-f7f415ad852f" status: 200 len: 1286 microversion: 2.20 time: 0.363937 Jul 01 04:04:56.848173 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 38/66] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Jul 1 04:04:56 2022] GET /compute/v2.1/servers/b904f233-887c-4c96-a2d2-f7f415ad852f => generated 1286 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 04:04:56.998364 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-d8986881-10a8-4d51-8b16-d7754060e501 tempest-DeleteServersTestJSON-285930608 tempest-DeleteServersTestJSON-285930608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab2da92b7e94592b80ef3d7852f51ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb56c390ed7649479455d6dc3904deb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:04:57.019187 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-d8986881-10a8-4d51-8b16-d7754060e501 tempest-DeleteServersTestJSON-285930608 tempest-DeleteServersTestJSON-285930608-project] 10.222.0.20 "GET /compute/v2.1/servers/3858eceb-54a4-4bac-beef-8acd0afafba7" status: 200 len: 1273 microversion: 2.1 time: 0.218459 Jul 01 04:04:57.045592 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 29/67] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:04:56 2022] GET /compute/v2.1/servers/3858eceb-54a4-4bac-beef-8acd0afafba7 => generated 1273 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:04:57.825800 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-3ded3a61-4780-4880-b824-ada827d5cb3a tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:04:57.827261 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-3ded3a61-4780-4880-b824-ada827d5cb3a tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] [instance: f0c5fb50-4991-45b2-803d-7bcfe51f7c34] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:04:57.843469 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-3ded3a61-4780-4880-b824-ada827d5cb3a tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:04:57.848369 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-3ded3a61-4780-4880-b824-ada827d5cb3a tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:04:57.848369 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-3ded3a61-4780-4880-b824-ada827d5cb3a tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:04:57.849973 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-3ded3a61-4780-4880-b824-ada827d5cb3a tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:04:57.870916 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-6a2fbcaf-091e-40ff-be87-9f2a007778f5 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:04:57.872957 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-6a2fbcaf-091e-40ff-be87-9f2a007778f5 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] [instance: b904f233-887c-4c96-a2d2-f7f415ad852f] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:04:57.892374 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-6a2fbcaf-091e-40ff-be87-9f2a007778f5 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:04:57.895084 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-6a2fbcaf-091e-40ff-be87-9f2a007778f5 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:04:57.900266 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-6a2fbcaf-091e-40ff-be87-9f2a007778f5 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:04:57.905008 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-6a2fbcaf-091e-40ff-be87-9f2a007778f5 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:04:58.030770 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-6a2fbcaf-091e-40ff-be87-9f2a007778f5 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:04:58.048809 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-6a2fbcaf-091e-40ff-be87-9f2a007778f5 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:04:58.054393 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-6a2fbcaf-091e-40ff-be87-9f2a007778f5 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:04:58.056092 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-6a2fbcaf-091e-40ff-be87-9f2a007778f5 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] 10.222.0.20 "GET /compute/v2.1/servers/b904f233-887c-4c96-a2d2-f7f415ad852f" status: 200 len: 1334 microversion: 2.20 time: 0.191036 Jul 01 04:04:58.058817 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 30/68] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Jul 1 04:04:57 2022] GET /compute/v2.1/servers/b904f233-887c-4c96-a2d2-f7f415ad852f => generated 1334 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 01 04:04:58.076284 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-41925c3a-c28e-4e35-a087-c74d78e54a5e tempest-DeleteServersTestJSON-285930608 tempest-DeleteServersTestJSON-285930608-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:04:58.077235 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-41925c3a-c28e-4e35-a087-c74d78e54a5e tempest-DeleteServersTestJSON-285930608 tempest-DeleteServersTestJSON-285930608-project] [instance: 3858eceb-54a4-4bac-beef-8acd0afafba7] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:04:58.090918 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-41925c3a-c28e-4e35-a087-c74d78e54a5e tempest-DeleteServersTestJSON-285930608 tempest-DeleteServersTestJSON-285930608-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:04:58.091420 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-41925c3a-c28e-4e35-a087-c74d78e54a5e tempest-DeleteServersTestJSON-285930608 tempest-DeleteServersTestJSON-285930608-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:04:58.097457 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-41925c3a-c28e-4e35-a087-c74d78e54a5e tempest-DeleteServersTestJSON-285930608 tempest-DeleteServersTestJSON-285930608-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:04:58.097940 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-41925c3a-c28e-4e35-a087-c74d78e54a5e tempest-DeleteServersTestJSON-285930608 tempest-DeleteServersTestJSON-285930608-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:04:58.557977 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-41925c3a-c28e-4e35-a087-c74d78e54a5e tempest-DeleteServersTestJSON-285930608 tempest-DeleteServersTestJSON-285930608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab2da92b7e94592b80ef3d7852f51ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb56c390ed7649479455d6dc3904deb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:04:58.569107 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-41925c3a-c28e-4e35-a087-c74d78e54a5e tempest-DeleteServersTestJSON-285930608 tempest-DeleteServersTestJSON-285930608-project] 10.222.0.20 "GET /compute/v2.1/servers/3858eceb-54a4-4bac-beef-8acd0afafba7" status: 200 len: 1315 microversion: 2.1 time: 0.497783 Jul 01 04:04:58.605303 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 31/69] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:04:58 2022] GET /compute/v2.1/servers/3858eceb-54a4-4bac-beef-8acd0afafba7 => generated 1315 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:04:58.638893 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-3ded3a61-4780-4880-b824-ada827d5cb3a tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8622ec5212c84d87b9b7c8f725012a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0143140d4f649478e36abcee284640c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:04:58.664862 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-3ded3a61-4780-4880-b824-ada827d5cb3a tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] 10.222.0.20 "GET /compute/v2.1/servers/f0c5fb50-4991-45b2-803d-7bcfe51f7c34" status: 200 len: 1319 microversion: 2.1 time: 0.843939 Jul 01 04:04:58.679680 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 39/70] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:04:57 2022] GET /compute/v2.1/servers/f0c5fb50-4991-45b2-803d-7bcfe51f7c34 => generated 1319 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:04:59.085889 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-4dfd0c30-ab14-48f7-ae89-616c79e4d1f2 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:04:59.092267 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-4dfd0c30-ab14-48f7-ae89-616c79e4d1f2 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] [instance: b904f233-887c-4c96-a2d2-f7f415ad852f] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:04:59.145297 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-4dfd0c30-ab14-48f7-ae89-616c79e4d1f2 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:04:59.152234 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-4dfd0c30-ab14-48f7-ae89-616c79e4d1f2 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:04:59.156656 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-4dfd0c30-ab14-48f7-ae89-616c79e4d1f2 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:04:59.168966 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-4dfd0c30-ab14-48f7-ae89-616c79e4d1f2 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:04:59.539742 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-4dfd0c30-ab14-48f7-ae89-616c79e4d1f2 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:04:59.539742 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-4dfd0c30-ab14-48f7-ae89-616c79e4d1f2 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:04:59.542134 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-4dfd0c30-ab14-48f7-ae89-616c79e4d1f2 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:04:59.542134 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-4dfd0c30-ab14-48f7-ae89-616c79e4d1f2 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] 10.222.0.20 "GET /compute/v2.1/servers/b904f233-887c-4c96-a2d2-f7f415ad852f" status: 200 len: 1340 microversion: 2.20 time: 0.431404 Jul 01 04:04:59.542134 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 32/71] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Jul 1 04:04:59 2022] GET /compute/v2.1/servers/b904f233-887c-4c96-a2d2-f7f415ad852f => generated 1340 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 04:04:59.622804 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-1afb2ba7-bb2e-492a-805b-0a040cac0718 tempest-DeleteServersTestJSON-285930608 tempest-DeleteServersTestJSON-285930608-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:04:59.628105 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-1afb2ba7-bb2e-492a-805b-0a040cac0718 tempest-DeleteServersTestJSON-285930608 tempest-DeleteServersTestJSON-285930608-project] [instance: 3858eceb-54a4-4bac-beef-8acd0afafba7] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:04:59.666139 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG dbcounter [-] [118712] Writing DB stats nova_cell0:SELECT=4 {{(pid=118712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:04:59.666139 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-1afb2ba7-bb2e-492a-805b-0a040cac0718 tempest-DeleteServersTestJSON-285930608 tempest-DeleteServersTestJSON-285930608-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:04:59.666139 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-1afb2ba7-bb2e-492a-805b-0a040cac0718 tempest-DeleteServersTestJSON-285930608 tempest-DeleteServersTestJSON-285930608-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:04:59.666139 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-1afb2ba7-bb2e-492a-805b-0a040cac0718 tempest-DeleteServersTestJSON-285930608 tempest-DeleteServersTestJSON-285930608-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:04:59.669002 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-1afb2ba7-bb2e-492a-805b-0a040cac0718 tempest-DeleteServersTestJSON-285930608 tempest-DeleteServersTestJSON-285930608-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:04:59.738115 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-f8158f20-e2c1-4287-8dc7-fcf6f07ca5d8 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:04:59.747819 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-f8158f20-e2c1-4287-8dc7-fcf6f07ca5d8 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] [instance: f0c5fb50-4991-45b2-803d-7bcfe51f7c34] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:04:59.768211 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-f8158f20-e2c1-4287-8dc7-fcf6f07ca5d8 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:04:59.779694 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-f8158f20-e2c1-4287-8dc7-fcf6f07ca5d8 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:04:59.782883 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-f8158f20-e2c1-4287-8dc7-fcf6f07ca5d8 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:04:59.783995 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-f8158f20-e2c1-4287-8dc7-fcf6f07ca5d8 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:05:00.053623 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-1afb2ba7-bb2e-492a-805b-0a040cac0718 tempest-DeleteServersTestJSON-285930608 tempest-DeleteServersTestJSON-285930608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab2da92b7e94592b80ef3d7852f51ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb56c390ed7649479455d6dc3904deb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:05:00.070099 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-1afb2ba7-bb2e-492a-805b-0a040cac0718 tempest-DeleteServersTestJSON-285930608 tempest-DeleteServersTestJSON-285930608-project] 10.222.0.20 "GET /compute/v2.1/servers/3858eceb-54a4-4bac-beef-8acd0afafba7" status: 200 len: 1315 microversion: 2.1 time: 0.460246 Jul 01 04:05:00.073034 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 40/72] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:04:59 2022] GET /compute/v2.1/servers/3858eceb-54a4-4bac-beef-8acd0afafba7 => generated 1315 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:05:00.543656 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-f8158f20-e2c1-4287-8dc7-fcf6f07ca5d8 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8622ec5212c84d87b9b7c8f725012a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0143140d4f649478e36abcee284640c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:05:00.554386 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-f8158f20-e2c1-4287-8dc7-fcf6f07ca5d8 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] 10.222.0.20 "GET /compute/v2.1/servers/f0c5fb50-4991-45b2-803d-7bcfe51f7c34" status: 200 len: 1319 microversion: 2.1 time: 0.852089 Jul 01 04:05:00.561963 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-c80cdae6-625d-4298-bbe8-9e005c693ae7 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:05:00.562595 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-c80cdae6-625d-4298-bbe8-9e005c693ae7 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] [instance: b904f233-887c-4c96-a2d2-f7f415ad852f] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:05:00.567386 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 33/73] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:04:59 2022] GET /compute/v2.1/servers/f0c5fb50-4991-45b2-803d-7bcfe51f7c34 => generated 1319 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:05:00.589514 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-c80cdae6-625d-4298-bbe8-9e005c693ae7 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:05:00.589989 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-c80cdae6-625d-4298-bbe8-9e005c693ae7 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:05:00.590814 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-c80cdae6-625d-4298-bbe8-9e005c693ae7 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:05:00.591293 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-c80cdae6-625d-4298-bbe8-9e005c693ae7 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:05:00.707842 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-c80cdae6-625d-4298-bbe8-9e005c693ae7 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:05:00.728828 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-c80cdae6-625d-4298-bbe8-9e005c693ae7 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:05:00.739959 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-c80cdae6-625d-4298-bbe8-9e005c693ae7 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:05:00.742544 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-c80cdae6-625d-4298-bbe8-9e005c693ae7 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] 10.222.0.20 "GET /compute/v2.1/servers/b904f233-887c-4c96-a2d2-f7f415ad852f" status: 200 len: 1340 microversion: 2.20 time: 0.184729 Jul 01 04:05:00.755100 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 41/74] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Jul 1 04:05:00 2022] GET /compute/v2.1/servers/b904f233-887c-4c96-a2d2-f7f415ad852f => generated 1340 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 01 04:05:01.094864 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-0d000352-3f5f-40e4-8ff3-b48631ce4138 tempest-DeleteServersTestJSON-285930608 tempest-DeleteServersTestJSON-285930608-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:05:01.096556 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-0d000352-3f5f-40e4-8ff3-b48631ce4138 tempest-DeleteServersTestJSON-285930608 tempest-DeleteServersTestJSON-285930608-project] [instance: 3858eceb-54a4-4bac-beef-8acd0afafba7] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:05:01.108987 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-0d000352-3f5f-40e4-8ff3-b48631ce4138 tempest-DeleteServersTestJSON-285930608 tempest-DeleteServersTestJSON-285930608-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:05:01.109758 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-0d000352-3f5f-40e4-8ff3-b48631ce4138 tempest-DeleteServersTestJSON-285930608 tempest-DeleteServersTestJSON-285930608-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:05:01.111349 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-0d000352-3f5f-40e4-8ff3-b48631ce4138 tempest-DeleteServersTestJSON-285930608 tempest-DeleteServersTestJSON-285930608-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:05:01.112409 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-0d000352-3f5f-40e4-8ff3-b48631ce4138 tempest-DeleteServersTestJSON-285930608 tempest-DeleteServersTestJSON-285930608-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:05:01.290252 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-0d000352-3f5f-40e4-8ff3-b48631ce4138 tempest-DeleteServersTestJSON-285930608 tempest-DeleteServersTestJSON-285930608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab2da92b7e94592b80ef3d7852f51ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb56c390ed7649479455d6dc3904deb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:05:01.306869 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-0d000352-3f5f-40e4-8ff3-b48631ce4138 tempest-DeleteServersTestJSON-285930608 tempest-DeleteServersTestJSON-285930608-project] 10.222.0.20 "GET /compute/v2.1/servers/3858eceb-54a4-4bac-beef-8acd0afafba7" status: 200 len: 1315 microversion: 2.1 time: 0.219252 Jul 01 04:05:01.312823 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 34/75] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:05:01 2022] GET /compute/v2.1/servers/3858eceb-54a4-4bac-beef-8acd0afafba7 => generated 1315 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:05:01.579471 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG dbcounter [-] [118712] Writing DB stats nova_cell0:SELECT=16 {{(pid=118712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:05:01.584349 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-b3a7c6f9-237e-4961-a3db-812e94f5f482 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:05:01.585115 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-b3a7c6f9-237e-4961-a3db-812e94f5f482 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] [instance: f0c5fb50-4991-45b2-803d-7bcfe51f7c34] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:05:01.592217 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-b3a7c6f9-237e-4961-a3db-812e94f5f482 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:05:01.592779 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-b3a7c6f9-237e-4961-a3db-812e94f5f482 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:05:01.593699 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-b3a7c6f9-237e-4961-a3db-812e94f5f482 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:05:01.594166 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-b3a7c6f9-237e-4961-a3db-812e94f5f482 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:05:01.788466 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-15a18b07-d385-48b4-b9e6-a197fd483a53 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:05:01.795969 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-15a18b07-d385-48b4-b9e6-a197fd483a53 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] [instance: b904f233-887c-4c96-a2d2-f7f415ad852f] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:05:01.858608 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-15a18b07-d385-48b4-b9e6-a197fd483a53 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:05:01.862379 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-15a18b07-d385-48b4-b9e6-a197fd483a53 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:05:01.867042 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-15a18b07-d385-48b4-b9e6-a197fd483a53 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:05:01.871976 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-15a18b07-d385-48b4-b9e6-a197fd483a53 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:05:02.190666 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-b3a7c6f9-237e-4961-a3db-812e94f5f482 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8622ec5212c84d87b9b7c8f725012a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0143140d4f649478e36abcee284640c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:05:02.217007 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-b3a7c6f9-237e-4961-a3db-812e94f5f482 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] 10.222.0.20 "GET /compute/v2.1/servers/f0c5fb50-4991-45b2-803d-7bcfe51f7c34" status: 200 len: 1319 microversion: 2.1 time: 0.634687 Jul 01 04:05:02.230051 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 42/76] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:05:01 2022] GET /compute/v2.1/servers/f0c5fb50-4991-45b2-803d-7bcfe51f7c34 => generated 1319 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:05:02.330124 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-2512ac6c-104c-40eb-a517-af0b91095054 tempest-DeleteServersTestJSON-285930608 tempest-DeleteServersTestJSON-285930608-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:05:02.331281 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-2512ac6c-104c-40eb-a517-af0b91095054 tempest-DeleteServersTestJSON-285930608 tempest-DeleteServersTestJSON-285930608-project] [instance: 3858eceb-54a4-4bac-beef-8acd0afafba7] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:05:02.392419 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-2512ac6c-104c-40eb-a517-af0b91095054 tempest-DeleteServersTestJSON-285930608 tempest-DeleteServersTestJSON-285930608-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:05:02.392419 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-2512ac6c-104c-40eb-a517-af0b91095054 tempest-DeleteServersTestJSON-285930608 tempest-DeleteServersTestJSON-285930608-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:05:02.392419 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-2512ac6c-104c-40eb-a517-af0b91095054 tempest-DeleteServersTestJSON-285930608 tempest-DeleteServersTestJSON-285930608-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:05:02.392419 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-2512ac6c-104c-40eb-a517-af0b91095054 tempest-DeleteServersTestJSON-285930608 tempest-DeleteServersTestJSON-285930608-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:05:02.486998 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-15a18b07-d385-48b4-b9e6-a197fd483a53 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:05:02.512746 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-15a18b07-d385-48b4-b9e6-a197fd483a53 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:05:02.515835 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-15a18b07-d385-48b4-b9e6-a197fd483a53 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:05:02.521361 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-15a18b07-d385-48b4-b9e6-a197fd483a53 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] 10.222.0.20 "GET /compute/v2.1/servers/b904f233-887c-4c96-a2d2-f7f415ad852f" status: 200 len: 1340 microversion: 2.20 time: 0.762352 Jul 01 04:05:02.542274 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 35/77] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Jul 1 04:05:01 2022] GET /compute/v2.1/servers/b904f233-887c-4c96-a2d2-f7f415ad852f => generated 1340 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 04:05:03.248560 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-da0ecbed-6700-4922-a6a1-c62ae00543f6 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:05:03.250819 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-da0ecbed-6700-4922-a6a1-c62ae00543f6 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] [instance: f0c5fb50-4991-45b2-803d-7bcfe51f7c34] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:05:03.264263 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-da0ecbed-6700-4922-a6a1-c62ae00543f6 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:05:03.265148 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-da0ecbed-6700-4922-a6a1-c62ae00543f6 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:05:03.266438 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-da0ecbed-6700-4922-a6a1-c62ae00543f6 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:05:03.269782 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-da0ecbed-6700-4922-a6a1-c62ae00543f6 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:05:03.556736 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-2512ac6c-104c-40eb-a517-af0b91095054 tempest-DeleteServersTestJSON-285930608 tempest-DeleteServersTestJSON-285930608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab2da92b7e94592b80ef3d7852f51ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb56c390ed7649479455d6dc3904deb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:05:03.567072 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-2512ac6c-104c-40eb-a517-af0b91095054 tempest-DeleteServersTestJSON-285930608 tempest-DeleteServersTestJSON-285930608-project] 10.222.0.20 "GET /compute/v2.1/servers/3858eceb-54a4-4bac-beef-8acd0afafba7" status: 200 len: 1315 microversion: 2.1 time: 1.241518 Jul 01 04:05:03.572722 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 43/78] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:05:02 2022] GET /compute/v2.1/servers/3858eceb-54a4-4bac-beef-8acd0afafba7 => generated 1315 bytes in 1251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 04:05:03.599022 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-2057d37f-bfa4-4c5e-9d3c-1767d0371dff tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:05:03.604920 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-2057d37f-bfa4-4c5e-9d3c-1767d0371dff tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] [instance: b904f233-887c-4c96-a2d2-f7f415ad852f] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:05:03.608128 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG dbcounter [-] [118711] Writing DB stats nova_cell0:SELECT=4 {{(pid=118711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:05:03.620887 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-2057d37f-bfa4-4c5e-9d3c-1767d0371dff tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:05:03.626224 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-2057d37f-bfa4-4c5e-9d3c-1767d0371dff tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:05:03.632080 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-2057d37f-bfa4-4c5e-9d3c-1767d0371dff tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:05:03.634243 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-2057d37f-bfa4-4c5e-9d3c-1767d0371dff tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:05:03.658179 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-da0ecbed-6700-4922-a6a1-c62ae00543f6 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8622ec5212c84d87b9b7c8f725012a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0143140d4f649478e36abcee284640c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:05:03.708706 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-da0ecbed-6700-4922-a6a1-c62ae00543f6 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] 10.222.0.20 "GET /compute/v2.1/servers/f0c5fb50-4991-45b2-803d-7bcfe51f7c34" status: 200 len: 1319 microversion: 2.1 time: 0.465552 Jul 01 04:05:03.712183 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 36/79] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:05:03 2022] GET /compute/v2.1/servers/f0c5fb50-4991-45b2-803d-7bcfe51f7c34 => generated 1319 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:05:04.243104 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-2057d37f-bfa4-4c5e-9d3c-1767d0371dff tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:05:04.259469 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-2057d37f-bfa4-4c5e-9d3c-1767d0371dff tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:05:04.261027 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-2057d37f-bfa4-4c5e-9d3c-1767d0371dff tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:05:04.262210 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-2057d37f-bfa4-4c5e-9d3c-1767d0371dff tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] 10.222.0.20 "GET /compute/v2.1/servers/b904f233-887c-4c96-a2d2-f7f415ad852f" status: 200 len: 1340 microversion: 2.20 time: 0.686814 Jul 01 04:05:04.272524 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 44/80] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Jul 1 04:05:03 2022] GET /compute/v2.1/servers/b904f233-887c-4c96-a2d2-f7f415ad852f => generated 1340 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 04:05:04.594318 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-8ea58d7f-85ea-4764-bfa0-8a2d010b7fe3 tempest-DeleteServersTestJSON-285930608 tempest-DeleteServersTestJSON-285930608-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:05:04.594318 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-8ea58d7f-85ea-4764-bfa0-8a2d010b7fe3 tempest-DeleteServersTestJSON-285930608 tempest-DeleteServersTestJSON-285930608-project] [instance: 3858eceb-54a4-4bac-beef-8acd0afafba7] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:05:04.606499 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG dbcounter [-] [118711] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=118711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:05:04.614743 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-8ea58d7f-85ea-4764-bfa0-8a2d010b7fe3 tempest-DeleteServersTestJSON-285930608 tempest-DeleteServersTestJSON-285930608-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:05:04.616784 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-8ea58d7f-85ea-4764-bfa0-8a2d010b7fe3 tempest-DeleteServersTestJSON-285930608 tempest-DeleteServersTestJSON-285930608-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:05:04.635606 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-8ea58d7f-85ea-4764-bfa0-8a2d010b7fe3 tempest-DeleteServersTestJSON-285930608 tempest-DeleteServersTestJSON-285930608-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:05:04.636721 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-8ea58d7f-85ea-4764-bfa0-8a2d010b7fe3 tempest-DeleteServersTestJSON-285930608 tempest-DeleteServersTestJSON-285930608-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:05:04.735555 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-0be57ac8-e269-427b-8e3a-723bd398c1ec tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:05:04.736870 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-0be57ac8-e269-427b-8e3a-723bd398c1ec tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] [instance: f0c5fb50-4991-45b2-803d-7bcfe51f7c34] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:05:04.759147 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-0be57ac8-e269-427b-8e3a-723bd398c1ec tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:05:04.760061 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-0be57ac8-e269-427b-8e3a-723bd398c1ec tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:05:04.768421 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-0be57ac8-e269-427b-8e3a-723bd398c1ec tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:05:04.778151 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-0be57ac8-e269-427b-8e3a-723bd398c1ec tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:05:05.376721 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG dbcounter [-] [118711] Writing DB stats nova_cell0:SELECT=30 {{(pid=118711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:05:05.483553 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-8ea58d7f-85ea-4764-bfa0-8a2d010b7fe3 tempest-DeleteServersTestJSON-285930608 tempest-DeleteServersTestJSON-285930608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab2da92b7e94592b80ef3d7852f51ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb56c390ed7649479455d6dc3904deb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:05:05.499904 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-8ea58d7f-85ea-4764-bfa0-8a2d010b7fe3 tempest-DeleteServersTestJSON-285930608 tempest-DeleteServersTestJSON-285930608-project] 10.222.0.20 "GET /compute/v2.1/servers/3858eceb-54a4-4bac-beef-8acd0afafba7" status: 200 len: 1315 microversion: 2.1 time: 0.912842 Jul 01 04:05:05.505496 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 37/81] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:05:04 2022] GET /compute/v2.1/servers/3858eceb-54a4-4bac-beef-8acd0afafba7 => generated 1315 bytes in 919 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:05:05.569073 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-30e3ea0f-5010-46ab-8b8a-787ba0b6c84d tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:05:05.575154 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-30e3ea0f-5010-46ab-8b8a-787ba0b6c84d tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] [instance: b904f233-887c-4c96-a2d2-f7f415ad852f] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:05:05.590333 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-30e3ea0f-5010-46ab-8b8a-787ba0b6c84d tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:05:05.592292 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-30e3ea0f-5010-46ab-8b8a-787ba0b6c84d tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:05:05.594975 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-30e3ea0f-5010-46ab-8b8a-787ba0b6c84d tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:05:05.597118 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-30e3ea0f-5010-46ab-8b8a-787ba0b6c84d tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:05:06.550493 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-0be57ac8-e269-427b-8e3a-723bd398c1ec tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8622ec5212c84d87b9b7c8f725012a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0143140d4f649478e36abcee284640c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:05:06.572881 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-0be57ac8-e269-427b-8e3a-723bd398c1ec tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] 10.222.0.20 "GET /compute/v2.1/servers/f0c5fb50-4991-45b2-803d-7bcfe51f7c34" status: 200 len: 1319 microversion: 2.1 time: 1.847081 Jul 01 04:05:06.575009 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 45/82] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:05:04 2022] GET /compute/v2.1/servers/f0c5fb50-4991-45b2-803d-7bcfe51f7c34 => generated 1319 bytes in 1851 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:05:06.669596 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-30e3ea0f-5010-46ab-8b8a-787ba0b6c84d tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:05:06.682395 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-30e3ea0f-5010-46ab-8b8a-787ba0b6c84d tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:05:06.684126 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-30e3ea0f-5010-46ab-8b8a-787ba0b6c84d tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:05:06.712095 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-30e3ea0f-5010-46ab-8b8a-787ba0b6c84d tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] 10.222.0.20 "GET /compute/v2.1/servers/b904f233-887c-4c96-a2d2-f7f415ad852f" status: 200 len: 1408 microversion: 2.20 time: 1.204794 Jul 01 04:05:06.712798 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 38/83] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Jul 1 04:05:05 2022] GET /compute/v2.1/servers/b904f233-887c-4c96-a2d2-f7f415ad852f => generated 1408 bytes in 1206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 04:05:06.728138 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-d0bca486-fb11-4b28-a43e-7aee9c5e3f81 tempest-DeleteServersTestJSON-285930608 tempest-DeleteServersTestJSON-285930608-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:05:06.742755 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-d0bca486-fb11-4b28-a43e-7aee9c5e3f81 tempest-DeleteServersTestJSON-285930608 tempest-DeleteServersTestJSON-285930608-project] [instance: 3858eceb-54a4-4bac-beef-8acd0afafba7] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:05:06.758233 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-d0bca486-fb11-4b28-a43e-7aee9c5e3f81 tempest-DeleteServersTestJSON-285930608 tempest-DeleteServersTestJSON-285930608-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:05:06.764613 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-d0bca486-fb11-4b28-a43e-7aee9c5e3f81 tempest-DeleteServersTestJSON-285930608 tempest-DeleteServersTestJSON-285930608-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:05:06.765763 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-d0bca486-fb11-4b28-a43e-7aee9c5e3f81 tempest-DeleteServersTestJSON-285930608 tempest-DeleteServersTestJSON-285930608-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:05:06.767815 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-d0bca486-fb11-4b28-a43e-7aee9c5e3f81 tempest-DeleteServersTestJSON-285930608 tempest-DeleteServersTestJSON-285930608-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:05:07.133444 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [req-147b2815-eff0-4fd7-9d14-0248eb24738d req-33ab929f-3995-490d-a677-34b52650430d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3858eceb-54a4-4bac-beef-8acd0afafba7", "tag": "26e078cc-b9b8-45c1-ba84-3bd54e2c9972"}]} {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 04:05:07.174737 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [req-147b2815-eff0-4fd7-9d14-0248eb24738d req-33ab929f-3995-490d-a677-34b52650430d service nova] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:05:07.181932 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [req-147b2815-eff0-4fd7-9d14-0248eb24738d req-33ab929f-3995-490d-a677-34b52650430d service nova] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:05:07.253929 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.compute.server_external_events [req-147b2815-eff0-4fd7-9d14-0248eb24738d req-33ab929f-3995-490d-a677-34b52650430d service nova] Creating event network-changed:26e078cc-b9b8-45c1-ba84-3bd54e2c9972 for instance 3858eceb-54a4-4bac-beef-8acd0afafba7 on hv-cinder-84684 Jul 01 04:05:07.258271 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [req-147b2815-eff0-4fd7-9d14-0248eb24738d req-33ab929f-3995-490d-a677-34b52650430d service nova] Acquired lock "compute-rpcapi-router" {{(pid=118712) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 01 04:05:07.264299 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-69b586f4-66bc-4b46-9384-b620def292df None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:05:07.264771 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-69b586f4-66bc-4b46-9384-b620def292df None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:05:07.277112 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-69b586f4-66bc-4b46-9384-b620def292df None None] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:05:07.278120 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-69b586f4-66bc-4b46-9384-b620def292df None None] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:05:07.292443 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.compute.rpcapi [None req-69b586f4-66bc-4b46-9384-b620def292df None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 01 04:05:07.293632 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-69b586f4-66bc-4b46-9384-b620def292df None None] Releasing lock "compute-rpcapi-router" {{(pid=118712) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 01 04:05:07.361152 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-69b586f4-66bc-4b46-9384-b620def292df None None] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.782187 Jul 01 04:05:07.362629 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 46/84] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Jul 1 04:05:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 04:05:07.935740 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [req-160554b3-7098-4a99-b8d3-155bd25c3ea6 req-15673c39-ab9b-4258-a7da-515ea8a76902 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cd6bb9ca-aa57-4dc3-98bc-8e3194003673", "tag": "733c3087-abf2-445f-b346-a1bea93c6bdb"}]} {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 04:05:07.963785 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG dbcounter [-] [118712] Writing DB stats nova_api:SELECT=59,nova_api:INSERT=6 {{(pid=118712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:05:07.973531 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [req-160554b3-7098-4a99-b8d3-155bd25c3ea6 req-15673c39-ab9b-4258-a7da-515ea8a76902 service nova] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:05:07.975777 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [req-160554b3-7098-4a99-b8d3-155bd25c3ea6 req-15673c39-ab9b-4258-a7da-515ea8a76902 service nova] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:05:08.013170 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.compute.server_external_events [req-160554b3-7098-4a99-b8d3-155bd25c3ea6 req-15673c39-ab9b-4258-a7da-515ea8a76902 service nova] Creating event network-changed:733c3087-abf2-445f-b346-a1bea93c6bdb for instance cd6bb9ca-aa57-4dc3-98bc-8e3194003673 on hv-cinder-84684 Jul 01 04:05:08.031652 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [req-160554b3-7098-4a99-b8d3-155bd25c3ea6 req-15673c39-ab9b-4258-a7da-515ea8a76902 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.666362 Jul 01 04:05:08.036757 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 47/85] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Jul 1 04:05:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 04:05:08.056337 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-a5936265-668c-4c9c-90ef-6afa9d232e7c tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:05:08.058740 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-a5936265-668c-4c9c-90ef-6afa9d232e7c tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] [instance: f0c5fb50-4991-45b2-803d-7bcfe51f7c34] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:05:08.082811 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-a5936265-668c-4c9c-90ef-6afa9d232e7c tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:05:08.092033 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-a5936265-668c-4c9c-90ef-6afa9d232e7c tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:05:08.115755 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-a5936265-668c-4c9c-90ef-6afa9d232e7c tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:05:08.115755 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-a5936265-668c-4c9c-90ef-6afa9d232e7c tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:05:08.226403 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-d0bca486-fb11-4b28-a43e-7aee9c5e3f81 tempest-DeleteServersTestJSON-285930608 tempest-DeleteServersTestJSON-285930608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab2da92b7e94592b80ef3d7852f51ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb56c390ed7649479455d6dc3904deb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:05:08.228903 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG dbcounter [-] [118711] Writing DB stats nova_cell1:SELECT=93 {{(pid=118711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:05:08.243459 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-d0bca486-fb11-4b28-a43e-7aee9c5e3f81 tempest-DeleteServersTestJSON-285930608 tempest-DeleteServersTestJSON-285930608-project] 10.222.0.20 "GET /compute/v2.1/servers/3858eceb-54a4-4bac-beef-8acd0afafba7" status: 200 len: 1315 microversion: 2.1 time: 1.529580 Jul 01 04:05:08.246512 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 39/86] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:05:06 2022] GET /compute/v2.1/servers/3858eceb-54a4-4bac-beef-8acd0afafba7 => generated 1315 bytes in 1533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:05:08.259646 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-e91d1088-8df7-413d-9fe5-f9c293874c2d tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:05:08.269403 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-e91d1088-8df7-413d-9fe5-f9c293874c2d tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] [instance: b904f233-887c-4c96-a2d2-f7f415ad852f] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:05:08.277661 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-e91d1088-8df7-413d-9fe5-f9c293874c2d tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:05:08.280170 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-e91d1088-8df7-413d-9fe5-f9c293874c2d tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:05:08.281227 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-e91d1088-8df7-413d-9fe5-f9c293874c2d tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:05:08.281889 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-e91d1088-8df7-413d-9fe5-f9c293874c2d tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:05:09.017449 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-e91d1088-8df7-413d-9fe5-f9c293874c2d tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:05:09.028314 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-e91d1088-8df7-413d-9fe5-f9c293874c2d tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:05:09.030430 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-e91d1088-8df7-413d-9fe5-f9c293874c2d tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:05:09.032311 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-e91d1088-8df7-413d-9fe5-f9c293874c2d tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] 10.222.0.20 "GET /compute/v2.1/servers/b904f233-887c-4c96-a2d2-f7f415ad852f" status: 200 len: 1408 microversion: 2.20 time: 0.784459 Jul 01 04:05:09.049407 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 40/87] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Jul 1 04:05:08 2022] GET /compute/v2.1/servers/b904f233-887c-4c96-a2d2-f7f415ad852f => generated 1408 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 04:05:09.266780 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-68c438f2-e8aa-45fc-9c37-dc5eeb3a3de0 tempest-DeleteServersTestJSON-285930608 tempest-DeleteServersTestJSON-285930608-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:05:09.268797 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-68c438f2-e8aa-45fc-9c37-dc5eeb3a3de0 tempest-DeleteServersTestJSON-285930608 tempest-DeleteServersTestJSON-285930608-project] [instance: 3858eceb-54a4-4bac-beef-8acd0afafba7] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:05:09.279356 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-68c438f2-e8aa-45fc-9c37-dc5eeb3a3de0 tempest-DeleteServersTestJSON-285930608 tempest-DeleteServersTestJSON-285930608-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:05:09.281108 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-68c438f2-e8aa-45fc-9c37-dc5eeb3a3de0 tempest-DeleteServersTestJSON-285930608 tempest-DeleteServersTestJSON-285930608-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:05:09.282141 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-68c438f2-e8aa-45fc-9c37-dc5eeb3a3de0 tempest-DeleteServersTestJSON-285930608 tempest-DeleteServersTestJSON-285930608-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:05:09.282798 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-68c438f2-e8aa-45fc-9c37-dc5eeb3a3de0 tempest-DeleteServersTestJSON-285930608 tempest-DeleteServersTestJSON-285930608-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:05:09.495703 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-a5936265-668c-4c9c-90ef-6afa9d232e7c tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8622ec5212c84d87b9b7c8f725012a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0143140d4f649478e36abcee284640c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:05:09.495703 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG dbcounter [-] [118712] Writing DB stats nova_cell1:SELECT=81 {{(pid=118712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:05:09.516637 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-a5936265-668c-4c9c-90ef-6afa9d232e7c tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] 10.222.0.20 "GET /compute/v2.1/servers/f0c5fb50-4991-45b2-803d-7bcfe51f7c34" status: 200 len: 1319 microversion: 2.1 time: 1.472657 Jul 01 04:05:09.521577 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 48/88] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:05:08 2022] GET /compute/v2.1/servers/f0c5fb50-4991-45b2-803d-7bcfe51f7c34 => generated 1319 bytes in 1484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:05:09.594725 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [req-2ff1174d-8a14-407f-a1ef-6183ad9c34f0 req-a4888003-8cb4-4bb4-a7b5-9a5096d278a5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f0c5fb50-4991-45b2-803d-7bcfe51f7c34", "tag": "36a5bee1-6336-437a-af48-b9f466c3f69d"}]} {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 04:05:09.637573 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [req-2ff1174d-8a14-407f-a1ef-6183ad9c34f0 req-a4888003-8cb4-4bb4-a7b5-9a5096d278a5 service nova] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:05:09.640306 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [req-2ff1174d-8a14-407f-a1ef-6183ad9c34f0 req-a4888003-8cb4-4bb4-a7b5-9a5096d278a5 service nova] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:05:09.709757 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.compute.server_external_events [req-2ff1174d-8a14-407f-a1ef-6183ad9c34f0 req-a4888003-8cb4-4bb4-a7b5-9a5096d278a5 service nova] Creating event network-changed:36a5bee1-6336-437a-af48-b9f466c3f69d for instance f0c5fb50-4991-45b2-803d-7bcfe51f7c34 on hv-cinder-84684 Jul 01 04:05:09.725629 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [req-2ff1174d-8a14-407f-a1ef-6183ad9c34f0 req-a4888003-8cb4-4bb4-a7b5-9a5096d278a5 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.143633 Jul 01 04:05:09.728992 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 49/89] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Jul 1 04:05:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 01 04:05:09.933272 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-68c438f2-e8aa-45fc-9c37-dc5eeb3a3de0 tempest-DeleteServersTestJSON-285930608 tempest-DeleteServersTestJSON-285930608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab2da92b7e94592b80ef3d7852f51ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb56c390ed7649479455d6dc3904deb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:05:09.961300 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-68c438f2-e8aa-45fc-9c37-dc5eeb3a3de0 tempest-DeleteServersTestJSON-285930608 tempest-DeleteServersTestJSON-285930608-project] 10.222.0.20 "GET /compute/v2.1/servers/3858eceb-54a4-4bac-beef-8acd0afafba7" status: 200 len: 1315 microversion: 2.1 time: 0.703588 Jul 01 04:05:09.972241 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 41/90] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:05:09 2022] GET /compute/v2.1/servers/3858eceb-54a4-4bac-beef-8acd0afafba7 => generated 1315 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:05:10.058501 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-a51ea0f0-59ab-4da9-b99b-7c04aac571c2 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:05:10.058501 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-a51ea0f0-59ab-4da9-b99b-7c04aac571c2 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] [instance: b904f233-887c-4c96-a2d2-f7f415ad852f] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:05:10.116509 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-a51ea0f0-59ab-4da9-b99b-7c04aac571c2 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:05:10.139194 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-a51ea0f0-59ab-4da9-b99b-7c04aac571c2 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:05:10.139194 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-a51ea0f0-59ab-4da9-b99b-7c04aac571c2 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:05:10.139194 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-a51ea0f0-59ab-4da9-b99b-7c04aac571c2 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:05:10.539200 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-6699def8-9854-420b-be1a-a5baf9b1b6c5 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:05:10.546271 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-6699def8-9854-420b-be1a-a5baf9b1b6c5 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] [instance: f0c5fb50-4991-45b2-803d-7bcfe51f7c34] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:05:10.567919 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-6699def8-9854-420b-be1a-a5baf9b1b6c5 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:05:10.569371 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-6699def8-9854-420b-be1a-a5baf9b1b6c5 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:05:10.572779 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-6699def8-9854-420b-be1a-a5baf9b1b6c5 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:05:10.574135 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-6699def8-9854-420b-be1a-a5baf9b1b6c5 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:05:11.122016 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-6699def8-9854-420b-be1a-a5baf9b1b6c5 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8622ec5212c84d87b9b7c8f725012a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0143140d4f649478e36abcee284640c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:05:11.142407 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-6699def8-9854-420b-be1a-a5baf9b1b6c5 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] 10.222.0.20 "GET /compute/v2.1/servers/f0c5fb50-4991-45b2-803d-7bcfe51f7c34" status: 200 len: 1319 microversion: 2.1 time: 0.610907 Jul 01 04:05:11.157485 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 42/91] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:05:10 2022] GET /compute/v2.1/servers/f0c5fb50-4991-45b2-803d-7bcfe51f7c34 => generated 1319 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:05:11.171810 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-29affafd-5007-427b-a41f-e17908cac17a tempest-DeleteServersTestJSON-285930608 tempest-DeleteServersTestJSON-285930608-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:05:11.171810 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-29affafd-5007-427b-a41f-e17908cac17a tempest-DeleteServersTestJSON-285930608 tempest-DeleteServersTestJSON-285930608-project] [instance: 3858eceb-54a4-4bac-beef-8acd0afafba7] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:05:11.183593 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-29affafd-5007-427b-a41f-e17908cac17a tempest-DeleteServersTestJSON-285930608 tempest-DeleteServersTestJSON-285930608-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:05:11.184945 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-29affafd-5007-427b-a41f-e17908cac17a tempest-DeleteServersTestJSON-285930608 tempest-DeleteServersTestJSON-285930608-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:05:11.186609 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-29affafd-5007-427b-a41f-e17908cac17a tempest-DeleteServersTestJSON-285930608 tempest-DeleteServersTestJSON-285930608-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:05:11.188548 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-29affafd-5007-427b-a41f-e17908cac17a tempest-DeleteServersTestJSON-285930608 tempest-DeleteServersTestJSON-285930608-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:05:11.480925 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-a51ea0f0-59ab-4da9-b99b-7c04aac571c2 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:05:11.509024 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-a51ea0f0-59ab-4da9-b99b-7c04aac571c2 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:05:11.513432 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-a51ea0f0-59ab-4da9-b99b-7c04aac571c2 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:05:11.516715 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-a51ea0f0-59ab-4da9-b99b-7c04aac571c2 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] 10.222.0.20 "GET /compute/v2.1/servers/b904f233-887c-4c96-a2d2-f7f415ad852f" status: 200 len: 1408 microversion: 2.20 time: 1.467257 Jul 01 04:05:11.532760 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 50/92] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Jul 1 04:05:10 2022] GET /compute/v2.1/servers/b904f233-887c-4c96-a2d2-f7f415ad852f => generated 1408 bytes in 1486 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 04:05:11.753375 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-29affafd-5007-427b-a41f-e17908cac17a tempest-DeleteServersTestJSON-285930608 tempest-DeleteServersTestJSON-285930608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab2da92b7e94592b80ef3d7852f51ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb56c390ed7649479455d6dc3904deb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:05:11.781318 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-29affafd-5007-427b-a41f-e17908cac17a tempest-DeleteServersTestJSON-285930608 tempest-DeleteServersTestJSON-285930608-project] 10.222.0.20 "GET /compute/v2.1/servers/3858eceb-54a4-4bac-beef-8acd0afafba7" status: 200 len: 1315 microversion: 2.1 time: 0.612478 Jul 01 04:05:11.785363 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 43/93] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:05:11 2022] GET /compute/v2.1/servers/3858eceb-54a4-4bac-beef-8acd0afafba7 => generated 1315 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:05:12.113963 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [req-efc38de0-06e0-4acf-8a19-0941337434b5 req-bae89053-bb1f-4d3f-b99f-0780888ce48e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b904f233-887c-4c96-a2d2-f7f415ad852f", "tag": "b1d88871-2b18-4397-8234-7831054c30f0"}]} {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 04:05:12.175638 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-7d53a828-1cd5-4480-a209-0039f2c9e93c tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:05:12.177059 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-7d53a828-1cd5-4480-a209-0039f2c9e93c tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] [instance: f0c5fb50-4991-45b2-803d-7bcfe51f7c34] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:05:12.177171 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [req-efc38de0-06e0-4acf-8a19-0941337434b5 req-bae89053-bb1f-4d3f-b99f-0780888ce48e service nova] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:05:12.189727 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-7d53a828-1cd5-4480-a209-0039f2c9e93c tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:05:12.191046 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-7d53a828-1cd5-4480-a209-0039f2c9e93c tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:05:12.191715 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [req-efc38de0-06e0-4acf-8a19-0941337434b5 req-bae89053-bb1f-4d3f-b99f-0780888ce48e service nova] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:05:12.193863 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-7d53a828-1cd5-4480-a209-0039f2c9e93c tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:05:12.194995 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-7d53a828-1cd5-4480-a209-0039f2c9e93c tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:05:12.232938 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.compute.server_external_events [req-efc38de0-06e0-4acf-8a19-0941337434b5 req-bae89053-bb1f-4d3f-b99f-0780888ce48e service nova] Creating event network-changed:b1d88871-2b18-4397-8234-7831054c30f0 for instance b904f233-887c-4c96-a2d2-f7f415ad852f on hv-cinder-84684 Jul 01 04:05:12.280039 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [req-efc38de0-06e0-4acf-8a19-0941337434b5 req-bae89053-bb1f-4d3f-b99f-0780888ce48e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.172906 Jul 01 04:05:12.284696 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 51/94] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Jul 1 04:05:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 04:05:12.550704 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-4d82d56a-e64e-469d-8995-3aa0f422cb53 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:05:12.552264 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-4d82d56a-e64e-469d-8995-3aa0f422cb53 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] [instance: b904f233-887c-4c96-a2d2-f7f415ad852f] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:05:12.571136 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-4d82d56a-e64e-469d-8995-3aa0f422cb53 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:05:12.571973 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-4d82d56a-e64e-469d-8995-3aa0f422cb53 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:05:12.573426 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-4d82d56a-e64e-469d-8995-3aa0f422cb53 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:05:12.576407 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-4d82d56a-e64e-469d-8995-3aa0f422cb53 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:05:12.718025 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-7d53a828-1cd5-4480-a209-0039f2c9e93c tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8622ec5212c84d87b9b7c8f725012a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0143140d4f649478e36abcee284640c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:05:12.736344 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-7d53a828-1cd5-4480-a209-0039f2c9e93c tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] 10.222.0.20 "GET /compute/v2.1/servers/f0c5fb50-4991-45b2-803d-7bcfe51f7c34" status: 200 len: 1319 microversion: 2.1 time: 0.568295 Jul 01 04:05:12.740900 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 44/95] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:05:12 2022] GET /compute/v2.1/servers/f0c5fb50-4991-45b2-803d-7bcfe51f7c34 => generated 1319 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:05:12.806943 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-4d099b7e-23f2-48bc-9965-ebb881b4bee3 tempest-DeleteServersTestJSON-285930608 tempest-DeleteServersTestJSON-285930608-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:05:12.809551 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-4d099b7e-23f2-48bc-9965-ebb881b4bee3 tempest-DeleteServersTestJSON-285930608 tempest-DeleteServersTestJSON-285930608-project] [instance: 3858eceb-54a4-4bac-beef-8acd0afafba7] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:05:12.822527 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-4d099b7e-23f2-48bc-9965-ebb881b4bee3 tempest-DeleteServersTestJSON-285930608 tempest-DeleteServersTestJSON-285930608-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:05:12.824215 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-4d099b7e-23f2-48bc-9965-ebb881b4bee3 tempest-DeleteServersTestJSON-285930608 tempest-DeleteServersTestJSON-285930608-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:05:12.825320 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-4d099b7e-23f2-48bc-9965-ebb881b4bee3 tempest-DeleteServersTestJSON-285930608 tempest-DeleteServersTestJSON-285930608-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:05:12.825924 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-4d099b7e-23f2-48bc-9965-ebb881b4bee3 tempest-DeleteServersTestJSON-285930608 tempest-DeleteServersTestJSON-285930608-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:05:12.968455 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-4d82d56a-e64e-469d-8995-3aa0f422cb53 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:05:12.992389 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-4d82d56a-e64e-469d-8995-3aa0f422cb53 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:05:12.995701 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-4d82d56a-e64e-469d-8995-3aa0f422cb53 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:05:12.998230 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-4d82d56a-e64e-469d-8995-3aa0f422cb53 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] 10.222.0.20 "GET /compute/v2.1/servers/b904f233-887c-4c96-a2d2-f7f415ad852f" status: 200 len: 1408 microversion: 2.20 time: 0.451745 Jul 01 04:05:12.999290 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 52/96] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Jul 1 04:05:12 2022] GET /compute/v2.1/servers/b904f233-887c-4c96-a2d2-f7f415ad852f => generated 1408 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 01 04:05:13.308664 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-4d099b7e-23f2-48bc-9965-ebb881b4bee3 tempest-DeleteServersTestJSON-285930608 tempest-DeleteServersTestJSON-285930608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab2da92b7e94592b80ef3d7852f51ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb56c390ed7649479455d6dc3904deb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:05:13.369738 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-4d099b7e-23f2-48bc-9965-ebb881b4bee3 tempest-DeleteServersTestJSON-285930608 tempest-DeleteServersTestJSON-285930608-project] 10.222.0.20 "GET /compute/v2.1/servers/3858eceb-54a4-4bac-beef-8acd0afafba7" status: 200 len: 1315 microversion: 2.1 time: 0.567882 Jul 01 04:05:13.373321 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 45/97] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:05:12 2022] GET /compute/v2.1/servers/3858eceb-54a4-4bac-beef-8acd0afafba7 => generated 1315 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 04:05:13.769934 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-de9454e3-539a-48a7-b13a-03dd06ceddf4 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:05:13.769934 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-de9454e3-539a-48a7-b13a-03dd06ceddf4 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] [instance: f0c5fb50-4991-45b2-803d-7bcfe51f7c34] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:05:13.778941 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-de9454e3-539a-48a7-b13a-03dd06ceddf4 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:05:13.779733 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-de9454e3-539a-48a7-b13a-03dd06ceddf4 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:05:13.781059 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-de9454e3-539a-48a7-b13a-03dd06ceddf4 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:05:13.782478 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-de9454e3-539a-48a7-b13a-03dd06ceddf4 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:05:14.027939 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-e4424a0c-6223-40ce-a607-da8290052226 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:05:14.029899 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-e4424a0c-6223-40ce-a607-da8290052226 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] [instance: b904f233-887c-4c96-a2d2-f7f415ad852f] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:05:14.041870 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-e4424a0c-6223-40ce-a607-da8290052226 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:05:14.045622 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-e4424a0c-6223-40ce-a607-da8290052226 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:05:14.045622 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-e4424a0c-6223-40ce-a607-da8290052226 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:05:14.045622 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-e4424a0c-6223-40ce-a607-da8290052226 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:05:14.081023 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-de9454e3-539a-48a7-b13a-03dd06ceddf4 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8622ec5212c84d87b9b7c8f725012a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0143140d4f649478e36abcee284640c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:05:14.115769 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-de9454e3-539a-48a7-b13a-03dd06ceddf4 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] 10.222.0.20 "GET /compute/v2.1/servers/f0c5fb50-4991-45b2-803d-7bcfe51f7c34" status: 200 len: 1319 microversion: 2.1 time: 0.356306 Jul 01 04:05:14.124026 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 53/98] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:05:13 2022] GET /compute/v2.1/servers/f0c5fb50-4991-45b2-803d-7bcfe51f7c34 => generated 1319 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:05:14.278903 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-e4424a0c-6223-40ce-a607-da8290052226 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:05:14.289601 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-e4424a0c-6223-40ce-a607-da8290052226 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:05:14.294380 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-e4424a0c-6223-40ce-a607-da8290052226 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:05:14.296698 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-e4424a0c-6223-40ce-a607-da8290052226 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] 10.222.0.20 "GET /compute/v2.1/servers/b904f233-887c-4c96-a2d2-f7f415ad852f" status: 200 len: 1408 microversion: 2.20 time: 0.273428 Jul 01 04:05:14.299929 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 46/99] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Jul 1 04:05:14 2022] GET /compute/v2.1/servers/b904f233-887c-4c96-a2d2-f7f415ad852f => generated 1408 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 04:05:14.398760 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-393e235f-0c77-4ca4-a0c3-e10db3a6b5d8 tempest-DeleteServersTestJSON-285930608 tempest-DeleteServersTestJSON-285930608-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:05:14.400846 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-393e235f-0c77-4ca4-a0c3-e10db3a6b5d8 tempest-DeleteServersTestJSON-285930608 tempest-DeleteServersTestJSON-285930608-project] [instance: 3858eceb-54a4-4bac-beef-8acd0afafba7] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:05:14.413800 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-393e235f-0c77-4ca4-a0c3-e10db3a6b5d8 tempest-DeleteServersTestJSON-285930608 tempest-DeleteServersTestJSON-285930608-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:05:14.415912 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-393e235f-0c77-4ca4-a0c3-e10db3a6b5d8 tempest-DeleteServersTestJSON-285930608 tempest-DeleteServersTestJSON-285930608-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:05:14.416619 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-393e235f-0c77-4ca4-a0c3-e10db3a6b5d8 tempest-DeleteServersTestJSON-285930608 tempest-DeleteServersTestJSON-285930608-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:05:14.417359 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-393e235f-0c77-4ca4-a0c3-e10db3a6b5d8 tempest-DeleteServersTestJSON-285930608 tempest-DeleteServersTestJSON-285930608-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:05:14.612544 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-393e235f-0c77-4ca4-a0c3-e10db3a6b5d8 tempest-DeleteServersTestJSON-285930608 tempest-DeleteServersTestJSON-285930608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab2da92b7e94592b80ef3d7852f51ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb56c390ed7649479455d6dc3904deb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:05:14.621864 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-393e235f-0c77-4ca4-a0c3-e10db3a6b5d8 tempest-DeleteServersTestJSON-285930608 tempest-DeleteServersTestJSON-285930608-project] 10.222.0.20 "GET /compute/v2.1/servers/3858eceb-54a4-4bac-beef-8acd0afafba7" status: 200 len: 1315 microversion: 2.1 time: 0.232094 Jul 01 04:05:14.622469 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 54/100] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:05:14 2022] GET /compute/v2.1/servers/3858eceb-54a4-4bac-beef-8acd0afafba7 => generated 1315 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:05:15.156146 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-4c19777c-8ddc-41d3-9202-69f299094d45 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:05:15.163951 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-4c19777c-8ddc-41d3-9202-69f299094d45 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] [instance: f0c5fb50-4991-45b2-803d-7bcfe51f7c34] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:05:15.176196 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-4c19777c-8ddc-41d3-9202-69f299094d45 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:05:15.183547 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-4c19777c-8ddc-41d3-9202-69f299094d45 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:05:15.183547 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-4c19777c-8ddc-41d3-9202-69f299094d45 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:05:15.183547 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-4c19777c-8ddc-41d3-9202-69f299094d45 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:05:15.324433 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-7a9887c2-db40-4579-8377-5b2705c3bef5 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:05:15.330586 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-7a9887c2-db40-4579-8377-5b2705c3bef5 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] [instance: b904f233-887c-4c96-a2d2-f7f415ad852f] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:05:15.352675 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-7a9887c2-db40-4579-8377-5b2705c3bef5 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:05:15.354530 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-7a9887c2-db40-4579-8377-5b2705c3bef5 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:05:15.356767 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-7a9887c2-db40-4579-8377-5b2705c3bef5 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:05:15.357885 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-7a9887c2-db40-4579-8377-5b2705c3bef5 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:05:15.714347 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-7a9887c2-db40-4579-8377-5b2705c3bef5 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:05:15.747200 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-7a9887c2-db40-4579-8377-5b2705c3bef5 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:05:15.759001 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-7a9887c2-db40-4579-8377-5b2705c3bef5 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:05:15.764904 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-7a9887c2-db40-4579-8377-5b2705c3bef5 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] 10.222.0.20 "GET /compute/v2.1/servers/b904f233-887c-4c96-a2d2-f7f415ad852f" status: 200 len: 1408 microversion: 2.20 time: 0.448448 Jul 01 04:05:15.773200 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 55/101] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Jul 1 04:05:15 2022] GET /compute/v2.1/servers/b904f233-887c-4c96-a2d2-f7f415ad852f => generated 1408 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 04:05:15.784265 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-246db41c-296f-4a89-a0ab-1a98c47cece2 tempest-DeleteServersTestJSON-285930608 tempest-DeleteServersTestJSON-285930608-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:05:15.801075 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-246db41c-296f-4a89-a0ab-1a98c47cece2 tempest-DeleteServersTestJSON-285930608 tempest-DeleteServersTestJSON-285930608-project] [instance: 3858eceb-54a4-4bac-beef-8acd0afafba7] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:05:15.821593 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-4c19777c-8ddc-41d3-9202-69f299094d45 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8622ec5212c84d87b9b7c8f725012a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0143140d4f649478e36abcee284640c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:05:15.830633 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-246db41c-296f-4a89-a0ab-1a98c47cece2 tempest-DeleteServersTestJSON-285930608 tempest-DeleteServersTestJSON-285930608-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:05:15.837292 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-246db41c-296f-4a89-a0ab-1a98c47cece2 tempest-DeleteServersTestJSON-285930608 tempest-DeleteServersTestJSON-285930608-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:05:15.845399 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-246db41c-296f-4a89-a0ab-1a98c47cece2 tempest-DeleteServersTestJSON-285930608 tempest-DeleteServersTestJSON-285930608-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:05:15.846770 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-246db41c-296f-4a89-a0ab-1a98c47cece2 tempest-DeleteServersTestJSON-285930608 tempest-DeleteServersTestJSON-285930608-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:05:15.856182 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-4c19777c-8ddc-41d3-9202-69f299094d45 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] 10.222.0.20 "GET /compute/v2.1/servers/f0c5fb50-4991-45b2-803d-7bcfe51f7c34" status: 200 len: 1319 microversion: 2.1 time: 0.707605 Jul 01 04:05:15.860113 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 47/102] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:05:15 2022] GET /compute/v2.1/servers/f0c5fb50-4991-45b2-803d-7bcfe51f7c34 => generated 1319 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:05:16.134480 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-246db41c-296f-4a89-a0ab-1a98c47cece2 tempest-DeleteServersTestJSON-285930608 tempest-DeleteServersTestJSON-285930608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab2da92b7e94592b80ef3d7852f51ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb56c390ed7649479455d6dc3904deb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:05:16.160358 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-246db41c-296f-4a89-a0ab-1a98c47cece2 tempest-DeleteServersTestJSON-285930608 tempest-DeleteServersTestJSON-285930608-project] 10.222.0.20 "GET /compute/v2.1/servers/3858eceb-54a4-4bac-beef-8acd0afafba7" status: 200 len: 1315 microversion: 2.1 time: 0.384913 Jul 01 04:05:16.161792 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 56/103] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:05:15 2022] GET /compute/v2.1/servers/3858eceb-54a4-4bac-beef-8acd0afafba7 => generated 1315 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:05:16.802699 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-8dfd325e-e3cf-4885-b8c7-fe8adba65c8c tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:05:16.804176 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-8dfd325e-e3cf-4885-b8c7-fe8adba65c8c tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] [instance: b904f233-887c-4c96-a2d2-f7f415ad852f] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:05:16.816094 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-8dfd325e-e3cf-4885-b8c7-fe8adba65c8c tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:05:16.817482 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-8dfd325e-e3cf-4885-b8c7-fe8adba65c8c tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:05:16.819402 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-8dfd325e-e3cf-4885-b8c7-fe8adba65c8c tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:05:16.824637 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-8dfd325e-e3cf-4885-b8c7-fe8adba65c8c tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:05:16.878585 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-215650fb-f0cd-4abf-99ca-ba5ca12457de tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:05:16.879331 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-215650fb-f0cd-4abf-99ca-ba5ca12457de tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] [instance: f0c5fb50-4991-45b2-803d-7bcfe51f7c34] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:05:16.907195 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-215650fb-f0cd-4abf-99ca-ba5ca12457de tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:05:16.910413 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-215650fb-f0cd-4abf-99ca-ba5ca12457de tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:05:16.916073 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-215650fb-f0cd-4abf-99ca-ba5ca12457de tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:05:16.916611 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-215650fb-f0cd-4abf-99ca-ba5ca12457de tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:05:17.121779 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-8dfd325e-e3cf-4885-b8c7-fe8adba65c8c tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:05:17.139710 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-8dfd325e-e3cf-4885-b8c7-fe8adba65c8c tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:05:17.144135 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-8dfd325e-e3cf-4885-b8c7-fe8adba65c8c tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:05:17.146351 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-8dfd325e-e3cf-4885-b8c7-fe8adba65c8c tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] 10.222.0.20 "GET /compute/v2.1/servers/b904f233-887c-4c96-a2d2-f7f415ad852f" status: 200 len: 1408 microversion: 2.20 time: 0.352741 Jul 01 04:05:17.147481 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 48/104] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Jul 1 04:05:16 2022] GET /compute/v2.1/servers/b904f233-887c-4c96-a2d2-f7f415ad852f => generated 1408 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 04:05:17.199170 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-9edc83b7-b031-4c3c-9eda-9a132efa6ec7 tempest-DeleteServersTestJSON-285930608 tempest-DeleteServersTestJSON-285930608-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:05:17.201768 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-9edc83b7-b031-4c3c-9eda-9a132efa6ec7 tempest-DeleteServersTestJSON-285930608 tempest-DeleteServersTestJSON-285930608-project] [instance: 3858eceb-54a4-4bac-beef-8acd0afafba7] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:05:17.215883 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-9edc83b7-b031-4c3c-9eda-9a132efa6ec7 tempest-DeleteServersTestJSON-285930608 tempest-DeleteServersTestJSON-285930608-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:05:17.216785 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-9edc83b7-b031-4c3c-9eda-9a132efa6ec7 tempest-DeleteServersTestJSON-285930608 tempest-DeleteServersTestJSON-285930608-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:05:17.220132 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-9edc83b7-b031-4c3c-9eda-9a132efa6ec7 tempest-DeleteServersTestJSON-285930608 tempest-DeleteServersTestJSON-285930608-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:05:17.224728 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-9edc83b7-b031-4c3c-9eda-9a132efa6ec7 tempest-DeleteServersTestJSON-285930608 tempest-DeleteServersTestJSON-285930608-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:05:17.285311 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-215650fb-f0cd-4abf-99ca-ba5ca12457de tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8622ec5212c84d87b9b7c8f725012a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0143140d4f649478e36abcee284640c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:05:17.301273 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG dbcounter [-] [118712] Writing DB stats nova_cell0:SELECT=2 {{(pid=118712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:05:17.313828 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-215650fb-f0cd-4abf-99ca-ba5ca12457de tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] 10.222.0.20 "GET /compute/v2.1/servers/f0c5fb50-4991-45b2-803d-7bcfe51f7c34" status: 200 len: 1319 microversion: 2.1 time: 0.440937 Jul 01 04:05:17.314805 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 57/105] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:05:16 2022] GET /compute/v2.1/servers/f0c5fb50-4991-45b2-803d-7bcfe51f7c34 => generated 1319 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 04:05:17.606005 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-9edc83b7-b031-4c3c-9eda-9a132efa6ec7 tempest-DeleteServersTestJSON-285930608 tempest-DeleteServersTestJSON-285930608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab2da92b7e94592b80ef3d7852f51ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb56c390ed7649479455d6dc3904deb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:05:17.628255 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-9edc83b7-b031-4c3c-9eda-9a132efa6ec7 tempest-DeleteServersTestJSON-285930608 tempest-DeleteServersTestJSON-285930608-project] 10.222.0.20 "GET /compute/v2.1/servers/3858eceb-54a4-4bac-beef-8acd0afafba7" status: 200 len: 1315 microversion: 2.1 time: 0.439923 Jul 01 04:05:17.637830 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 49/106] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:05:17 2022] GET /compute/v2.1/servers/3858eceb-54a4-4bac-beef-8acd0afafba7 => generated 1315 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:05:18.186363 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-48ffcbf9-54b0-4fef-9f2e-e92a762923aa tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:05:18.187369 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-48ffcbf9-54b0-4fef-9f2e-e92a762923aa tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] [instance: b904f233-887c-4c96-a2d2-f7f415ad852f] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:05:18.197118 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-48ffcbf9-54b0-4fef-9f2e-e92a762923aa tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:05:18.198003 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-48ffcbf9-54b0-4fef-9f2e-e92a762923aa tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:05:18.200264 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-48ffcbf9-54b0-4fef-9f2e-e92a762923aa tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:05:18.201041 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-48ffcbf9-54b0-4fef-9f2e-e92a762923aa tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:05:18.341754 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-5d98dce3-becb-4013-a774-6d1536fd7f6e tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:05:18.345974 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-5d98dce3-becb-4013-a774-6d1536fd7f6e tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] [instance: f0c5fb50-4991-45b2-803d-7bcfe51f7c34] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:05:18.354901 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-5d98dce3-becb-4013-a774-6d1536fd7f6e tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:05:18.355745 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-5d98dce3-becb-4013-a774-6d1536fd7f6e tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:05:18.356592 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-5d98dce3-becb-4013-a774-6d1536fd7f6e tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:05:18.357035 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-5d98dce3-becb-4013-a774-6d1536fd7f6e tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:05:18.509199 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-48ffcbf9-54b0-4fef-9f2e-e92a762923aa tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:05:18.530072 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-48ffcbf9-54b0-4fef-9f2e-e92a762923aa tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:05:18.536502 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-48ffcbf9-54b0-4fef-9f2e-e92a762923aa tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:05:18.541143 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-48ffcbf9-54b0-4fef-9f2e-e92a762923aa tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] 10.222.0.20 "GET /compute/v2.1/servers/b904f233-887c-4c96-a2d2-f7f415ad852f" status: 200 len: 1408 microversion: 2.20 time: 0.359054 Jul 01 04:05:18.542318 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 58/107] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Jul 1 04:05:18 2022] GET /compute/v2.1/servers/b904f233-887c-4c96-a2d2-f7f415ad852f => generated 1408 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 04:05:18.551185 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-5d98dce3-becb-4013-a774-6d1536fd7f6e tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8622ec5212c84d87b9b7c8f725012a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0143140d4f649478e36abcee284640c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:05:18.566415 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-5d98dce3-becb-4013-a774-6d1536fd7f6e tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] 10.222.0.20 "GET /compute/v2.1/servers/f0c5fb50-4991-45b2-803d-7bcfe51f7c34" status: 200 len: 1319 microversion: 2.1 time: 0.228806 Jul 01 04:05:18.567583 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 50/108] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:05:18 2022] GET /compute/v2.1/servers/f0c5fb50-4991-45b2-803d-7bcfe51f7c34 => generated 1319 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:05:18.655097 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-2fccd0e3-d5ea-4f14-b861-c62db017db2b tempest-DeleteServersTestJSON-285930608 tempest-DeleteServersTestJSON-285930608-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:05:18.656188 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-2fccd0e3-d5ea-4f14-b861-c62db017db2b tempest-DeleteServersTestJSON-285930608 tempest-DeleteServersTestJSON-285930608-project] [instance: 3858eceb-54a4-4bac-beef-8acd0afafba7] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:05:18.667917 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-2fccd0e3-d5ea-4f14-b861-c62db017db2b tempest-DeleteServersTestJSON-285930608 tempest-DeleteServersTestJSON-285930608-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:05:18.667917 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-2fccd0e3-d5ea-4f14-b861-c62db017db2b tempest-DeleteServersTestJSON-285930608 tempest-DeleteServersTestJSON-285930608-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:05:18.667917 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-2fccd0e3-d5ea-4f14-b861-c62db017db2b tempest-DeleteServersTestJSON-285930608 tempest-DeleteServersTestJSON-285930608-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:05:18.667917 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-2fccd0e3-d5ea-4f14-b861-c62db017db2b tempest-DeleteServersTestJSON-285930608 tempest-DeleteServersTestJSON-285930608-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:05:18.867393 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-2fccd0e3-d5ea-4f14-b861-c62db017db2b tempest-DeleteServersTestJSON-285930608 tempest-DeleteServersTestJSON-285930608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab2da92b7e94592b80ef3d7852f51ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb56c390ed7649479455d6dc3904deb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:05:18.879467 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-2fccd0e3-d5ea-4f14-b861-c62db017db2b tempest-DeleteServersTestJSON-285930608 tempest-DeleteServersTestJSON-285930608-project] 10.222.0.20 "GET /compute/v2.1/servers/3858eceb-54a4-4bac-beef-8acd0afafba7" status: 200 len: 1315 microversion: 2.1 time: 0.229728 Jul 01 04:05:18.880082 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 59/109] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:05:18 2022] GET /compute/v2.1/servers/3858eceb-54a4-4bac-beef-8acd0afafba7 => generated 1315 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:05:19.562775 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-deec3a7f-f02f-4fce-82a0-b0deb1bfc742 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:05:19.565452 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-deec3a7f-f02f-4fce-82a0-b0deb1bfc742 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] [instance: b904f233-887c-4c96-a2d2-f7f415ad852f] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:05:19.585900 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-deec3a7f-f02f-4fce-82a0-b0deb1bfc742 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:05:19.586374 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-deec3a7f-f02f-4fce-82a0-b0deb1bfc742 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:05:19.587565 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-deec3a7f-f02f-4fce-82a0-b0deb1bfc742 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:05:19.591587 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-deec3a7f-f02f-4fce-82a0-b0deb1bfc742 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:05:19.601804 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-fc149358-823c-4810-a2ac-c6e45c31f748 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:05:19.605411 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-fc149358-823c-4810-a2ac-c6e45c31f748 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] [instance: f0c5fb50-4991-45b2-803d-7bcfe51f7c34] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:05:19.638094 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-fc149358-823c-4810-a2ac-c6e45c31f748 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:05:19.638595 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-fc149358-823c-4810-a2ac-c6e45c31f748 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:05:19.648139 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-fc149358-823c-4810-a2ac-c6e45c31f748 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:05:19.653182 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-fc149358-823c-4810-a2ac-c6e45c31f748 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:05:19.884952 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-deec3a7f-f02f-4fce-82a0-b0deb1bfc742 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:05:19.895152 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-deec3a7f-f02f-4fce-82a0-b0deb1bfc742 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:05:19.897282 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-deec3a7f-f02f-4fce-82a0-b0deb1bfc742 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:05:19.898545 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-deec3a7f-f02f-4fce-82a0-b0deb1bfc742 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] 10.222.0.20 "GET /compute/v2.1/servers/b904f233-887c-4c96-a2d2-f7f415ad852f" status: 200 len: 1408 microversion: 2.20 time: 0.341186 Jul 01 04:05:19.899133 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 51/110] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Jul 1 04:05:19 2022] GET /compute/v2.1/servers/b904f233-887c-4c96-a2d2-f7f415ad852f => generated 1408 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 04:05:19.905009 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-d3157b3a-f7d6-40e8-adac-0c3c468872b2 tempest-DeleteServersTestJSON-285930608 tempest-DeleteServersTestJSON-285930608-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:05:19.905927 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-d3157b3a-f7d6-40e8-adac-0c3c468872b2 tempest-DeleteServersTestJSON-285930608 tempest-DeleteServersTestJSON-285930608-project] [instance: 3858eceb-54a4-4bac-beef-8acd0afafba7] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:05:19.924340 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-d3157b3a-f7d6-40e8-adac-0c3c468872b2 tempest-DeleteServersTestJSON-285930608 tempest-DeleteServersTestJSON-285930608-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:05:19.925108 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-d3157b3a-f7d6-40e8-adac-0c3c468872b2 tempest-DeleteServersTestJSON-285930608 tempest-DeleteServersTestJSON-285930608-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:05:19.926460 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-d3157b3a-f7d6-40e8-adac-0c3c468872b2 tempest-DeleteServersTestJSON-285930608 tempest-DeleteServersTestJSON-285930608-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:05:19.927258 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-d3157b3a-f7d6-40e8-adac-0c3c468872b2 tempest-DeleteServersTestJSON-285930608 tempest-DeleteServersTestJSON-285930608-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:05:20.044014 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-fc149358-823c-4810-a2ac-c6e45c31f748 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8622ec5212c84d87b9b7c8f725012a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0143140d4f649478e36abcee284640c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:05:20.056422 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-fc149358-823c-4810-a2ac-c6e45c31f748 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] 10.222.0.20 "GET /compute/v2.1/servers/f0c5fb50-4991-45b2-803d-7bcfe51f7c34" status: 200 len: 1319 microversion: 2.1 time: 0.466786 Jul 01 04:05:20.057561 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 60/111] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:05:19 2022] GET /compute/v2.1/servers/f0c5fb50-4991-45b2-803d-7bcfe51f7c34 => generated 1319 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:05:20.332686 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-d3157b3a-f7d6-40e8-adac-0c3c468872b2 tempest-DeleteServersTestJSON-285930608 tempest-DeleteServersTestJSON-285930608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab2da92b7e94592b80ef3d7852f51ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb56c390ed7649479455d6dc3904deb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:05:20.353372 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-d3157b3a-f7d6-40e8-adac-0c3c468872b2 tempest-DeleteServersTestJSON-285930608 tempest-DeleteServersTestJSON-285930608-project] 10.222.0.20 "GET /compute/v2.1/servers/3858eceb-54a4-4bac-beef-8acd0afafba7" status: 200 len: 1315 microversion: 2.1 time: 0.452721 Jul 01 04:05:20.354217 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 52/112] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:05:19 2022] GET /compute/v2.1/servers/3858eceb-54a4-4bac-beef-8acd0afafba7 => generated 1315 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:05:20.930468 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-52e328a5-cc72-4a6b-99b8-0f1a7bfe88ca tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:05:20.931391 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-52e328a5-cc72-4a6b-99b8-0f1a7bfe88ca tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] [instance: b904f233-887c-4c96-a2d2-f7f415ad852f] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:05:20.943764 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-52e328a5-cc72-4a6b-99b8-0f1a7bfe88ca tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:05:20.944563 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-52e328a5-cc72-4a6b-99b8-0f1a7bfe88ca tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:05:20.946179 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-52e328a5-cc72-4a6b-99b8-0f1a7bfe88ca tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:05:20.947215 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-52e328a5-cc72-4a6b-99b8-0f1a7bfe88ca tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:05:21.082681 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-d010fa99-89c5-4fc6-91f6-d1dfb599dcea tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:05:21.083351 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-d010fa99-89c5-4fc6-91f6-d1dfb599dcea tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] [instance: f0c5fb50-4991-45b2-803d-7bcfe51f7c34] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:05:21.089972 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-d010fa99-89c5-4fc6-91f6-d1dfb599dcea tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:05:21.090570 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-d010fa99-89c5-4fc6-91f6-d1dfb599dcea tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:05:21.106544 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-d010fa99-89c5-4fc6-91f6-d1dfb599dcea tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:05:21.106544 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-d010fa99-89c5-4fc6-91f6-d1dfb599dcea tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:05:21.148155 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-52e328a5-cc72-4a6b-99b8-0f1a7bfe88ca tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:05:21.162089 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-52e328a5-cc72-4a6b-99b8-0f1a7bfe88ca tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:05:21.165838 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-52e328a5-cc72-4a6b-99b8-0f1a7bfe88ca tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:05:21.167925 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-52e328a5-cc72-4a6b-99b8-0f1a7bfe88ca tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] 10.222.0.20 "GET /compute/v2.1/servers/b904f233-887c-4c96-a2d2-f7f415ad852f" status: 200 len: 1408 microversion: 2.20 time: 0.245129 Jul 01 04:05:21.168662 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 61/113] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Jul 1 04:05:20 2022] GET /compute/v2.1/servers/b904f233-887c-4c96-a2d2-f7f415ad852f => generated 1408 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 04:05:21.379776 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-cc9e0aa3-5bc8-4ac1-8d66-55be4eb60374 tempest-DeleteServersTestJSON-285930608 tempest-DeleteServersTestJSON-285930608-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:05:21.380725 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-cc9e0aa3-5bc8-4ac1-8d66-55be4eb60374 tempest-DeleteServersTestJSON-285930608 tempest-DeleteServersTestJSON-285930608-project] [instance: 3858eceb-54a4-4bac-beef-8acd0afafba7] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:05:21.396337 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-cc9e0aa3-5bc8-4ac1-8d66-55be4eb60374 tempest-DeleteServersTestJSON-285930608 tempest-DeleteServersTestJSON-285930608-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:05:21.404255 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-cc9e0aa3-5bc8-4ac1-8d66-55be4eb60374 tempest-DeleteServersTestJSON-285930608 tempest-DeleteServersTestJSON-285930608-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:05:21.405216 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-cc9e0aa3-5bc8-4ac1-8d66-55be4eb60374 tempest-DeleteServersTestJSON-285930608 tempest-DeleteServersTestJSON-285930608-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:05:21.406565 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-cc9e0aa3-5bc8-4ac1-8d66-55be4eb60374 tempest-DeleteServersTestJSON-285930608 tempest-DeleteServersTestJSON-285930608-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:05:21.479041 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-d010fa99-89c5-4fc6-91f6-d1dfb599dcea tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8622ec5212c84d87b9b7c8f725012a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0143140d4f649478e36abcee284640c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:05:21.498157 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-d010fa99-89c5-4fc6-91f6-d1dfb599dcea tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] 10.222.0.20 "GET /compute/v2.1/servers/f0c5fb50-4991-45b2-803d-7bcfe51f7c34" status: 200 len: 1319 microversion: 2.1 time: 0.419419 Jul 01 04:05:21.503377 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 53/114] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:05:21 2022] GET /compute/v2.1/servers/f0c5fb50-4991-45b2-803d-7bcfe51f7c34 => generated 1319 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 04:05:21.597665 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-cc9e0aa3-5bc8-4ac1-8d66-55be4eb60374 tempest-DeleteServersTestJSON-285930608 tempest-DeleteServersTestJSON-285930608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab2da92b7e94592b80ef3d7852f51ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb56c390ed7649479455d6dc3904deb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:05:21.606198 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-cc9e0aa3-5bc8-4ac1-8d66-55be4eb60374 tempest-DeleteServersTestJSON-285930608 tempest-DeleteServersTestJSON-285930608-project] 10.222.0.20 "GET /compute/v2.1/servers/3858eceb-54a4-4bac-beef-8acd0afafba7" status: 200 len: 1315 microversion: 2.1 time: 0.234616 Jul 01 04:05:21.606986 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 62/115] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:05:21 2022] GET /compute/v2.1/servers/3858eceb-54a4-4bac-beef-8acd0afafba7 => generated 1315 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:05:22.193019 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-74a9805b-70d1-45b9-b492-5fcd011c54c4 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:05:22.201852 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-74a9805b-70d1-45b9-b492-5fcd011c54c4 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] [instance: b904f233-887c-4c96-a2d2-f7f415ad852f] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:05:22.219559 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-74a9805b-70d1-45b9-b492-5fcd011c54c4 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:05:22.220509 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-74a9805b-70d1-45b9-b492-5fcd011c54c4 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:05:22.222107 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-74a9805b-70d1-45b9-b492-5fcd011c54c4 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:05:22.222909 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-74a9805b-70d1-45b9-b492-5fcd011c54c4 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:05:22.529537 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-cede56ed-9fd0-480b-843f-cb47f6c9c4b6 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:05:22.530844 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-cede56ed-9fd0-480b-843f-cb47f6c9c4b6 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] [instance: f0c5fb50-4991-45b2-803d-7bcfe51f7c34] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:05:22.553630 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-cede56ed-9fd0-480b-843f-cb47f6c9c4b6 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:05:22.554435 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-cede56ed-9fd0-480b-843f-cb47f6c9c4b6 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:05:22.555423 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-74a9805b-70d1-45b9-b492-5fcd011c54c4 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:05:22.555940 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-cede56ed-9fd0-480b-843f-cb47f6c9c4b6 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:05:22.556824 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-cede56ed-9fd0-480b-843f-cb47f6c9c4b6 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:05:22.590609 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-74a9805b-70d1-45b9-b492-5fcd011c54c4 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:05:22.594334 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-74a9805b-70d1-45b9-b492-5fcd011c54c4 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:05:22.605503 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-74a9805b-70d1-45b9-b492-5fcd011c54c4 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] 10.222.0.20 "GET /compute/v2.1/servers/b904f233-887c-4c96-a2d2-f7f415ad852f" status: 200 len: 1408 microversion: 2.20 time: 0.416417 Jul 01 04:05:22.607814 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 54/116] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Jul 1 04:05:22 2022] GET /compute/v2.1/servers/b904f233-887c-4c96-a2d2-f7f415ad852f => generated 1408 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 04:05:22.824052 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [req-dc796316-a6de-4f39-9335-1aefd8d384fc req-4da2ab7d-02d0-44cf-88c2-6858ab92f01c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3858eceb-54a4-4bac-beef-8acd0afafba7", "name": "network-vif-plugged", "status": "completed", "tag": "26e078cc-b9b8-45c1-ba84-3bd54e2c9972"}]} {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 04:05:22.849944 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [req-dc796316-a6de-4f39-9335-1aefd8d384fc req-4da2ab7d-02d0-44cf-88c2-6858ab92f01c service nova] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:05:22.851788 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [req-dc796316-a6de-4f39-9335-1aefd8d384fc req-4da2ab7d-02d0-44cf-88c2-6858ab92f01c service nova] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:05:22.900103 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.compute.server_external_events [req-dc796316-a6de-4f39-9335-1aefd8d384fc req-4da2ab7d-02d0-44cf-88c2-6858ab92f01c service nova] Creating event network-vif-plugged:26e078cc-b9b8-45c1-ba84-3bd54e2c9972 for instance 3858eceb-54a4-4bac-beef-8acd0afafba7 on hv-cinder-84684 Jul 01 04:05:22.901435 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [req-dc796316-a6de-4f39-9335-1aefd8d384fc req-4da2ab7d-02d0-44cf-88c2-6858ab92f01c service nova] Acquired lock "compute-rpcapi-router" {{(pid=118711) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 01 04:05:22.905822 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-07b8d185-033a-42a4-8578-ae4e43fa4493 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:05:22.907143 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-07b8d185-033a-42a4-8578-ae4e43fa4493 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:05:22.908267 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-07b8d185-033a-42a4-8578-ae4e43fa4493 None None] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:05:22.908901 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-07b8d185-033a-42a4-8578-ae4e43fa4493 None None] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:05:22.921536 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.compute.rpcapi [None req-07b8d185-033a-42a4-8578-ae4e43fa4493 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 01 04:05:22.922757 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-07b8d185-033a-42a4-8578-ae4e43fa4493 None None] Releasing lock "compute-rpcapi-router" {{(pid=118711) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 01 04:05:22.956262 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-cede56ed-9fd0-480b-843f-cb47f6c9c4b6 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8622ec5212c84d87b9b7c8f725012a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0143140d4f649478e36abcee284640c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:05:22.956604 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-07b8d185-033a-42a4-8578-ae4e43fa4493 None None] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.345438 Jul 01 04:05:22.959400 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 55/117] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Jul 1 04:05:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 04:05:22.968090 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-bad47e1a-244c-44b4-bd97-bb9bf5996e60 tempest-DeleteServersTestJSON-285930608 tempest-DeleteServersTestJSON-285930608-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:05:22.970125 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-bad47e1a-244c-44b4-bd97-bb9bf5996e60 tempest-DeleteServersTestJSON-285930608 tempest-DeleteServersTestJSON-285930608-project] [instance: 3858eceb-54a4-4bac-beef-8acd0afafba7] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:05:22.972509 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-cede56ed-9fd0-480b-843f-cb47f6c9c4b6 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] 10.222.0.20 "GET /compute/v2.1/servers/f0c5fb50-4991-45b2-803d-7bcfe51f7c34" status: 200 len: 1319 microversion: 2.1 time: 0.458892 Jul 01 04:05:22.974291 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 63/118] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:05:22 2022] GET /compute/v2.1/servers/f0c5fb50-4991-45b2-803d-7bcfe51f7c34 => generated 1319 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:05:22.980704 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-bad47e1a-244c-44b4-bd97-bb9bf5996e60 tempest-DeleteServersTestJSON-285930608 tempest-DeleteServersTestJSON-285930608-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:05:22.981764 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-bad47e1a-244c-44b4-bd97-bb9bf5996e60 tempest-DeleteServersTestJSON-285930608 tempest-DeleteServersTestJSON-285930608-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:05:22.983671 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-bad47e1a-244c-44b4-bd97-bb9bf5996e60 tempest-DeleteServersTestJSON-285930608 tempest-DeleteServersTestJSON-285930608-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:05:22.984981 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-bad47e1a-244c-44b4-bd97-bb9bf5996e60 tempest-DeleteServersTestJSON-285930608 tempest-DeleteServersTestJSON-285930608-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:05:23.185400 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-bad47e1a-244c-44b4-bd97-bb9bf5996e60 tempest-DeleteServersTestJSON-285930608 tempest-DeleteServersTestJSON-285930608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab2da92b7e94592b80ef3d7852f51ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb56c390ed7649479455d6dc3904deb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:05:23.194124 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG dbcounter [-] [118711] Writing DB stats nova_cell1:SELECT=100 {{(pid=118711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:05:23.207211 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-bad47e1a-244c-44b4-bd97-bb9bf5996e60 tempest-DeleteServersTestJSON-285930608 tempest-DeleteServersTestJSON-285930608-project] 10.222.0.20 "GET /compute/v2.1/servers/3858eceb-54a4-4bac-beef-8acd0afafba7" status: 200 len: 1315 microversion: 2.1 time: 0.244540 Jul 01 04:05:23.219352 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 56/119] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:05:22 2022] GET /compute/v2.1/servers/3858eceb-54a4-4bac-beef-8acd0afafba7 => generated 1315 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:05:23.627032 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-e0057f5e-29a0-4a8f-829e-686b5ed19aac tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:05:23.627032 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-e0057f5e-29a0-4a8f-829e-686b5ed19aac tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] [instance: b904f233-887c-4c96-a2d2-f7f415ad852f] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:05:23.633495 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-e0057f5e-29a0-4a8f-829e-686b5ed19aac tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:05:23.634196 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-e0057f5e-29a0-4a8f-829e-686b5ed19aac tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:05:23.635194 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-e0057f5e-29a0-4a8f-829e-686b5ed19aac tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:05:23.635660 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-e0057f5e-29a0-4a8f-829e-686b5ed19aac tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:05:23.822458 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-e0057f5e-29a0-4a8f-829e-686b5ed19aac tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:05:23.841148 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-e0057f5e-29a0-4a8f-829e-686b5ed19aac tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:05:23.845287 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-e0057f5e-29a0-4a8f-829e-686b5ed19aac tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:05:23.847757 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-e0057f5e-29a0-4a8f-829e-686b5ed19aac tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] 10.222.0.20 "GET /compute/v2.1/servers/b904f233-887c-4c96-a2d2-f7f415ad852f" status: 200 len: 1408 microversion: 2.20 time: 0.226587 Jul 01 04:05:23.849096 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 64/120] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Jul 1 04:05:23 2022] GET /compute/v2.1/servers/b904f233-887c-4c96-a2d2-f7f415ad852f => generated 1408 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 01 04:05:23.994223 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-900eb49e-ee56-4a13-a22a-57e0c1e880b9 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:05:23.995469 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-900eb49e-ee56-4a13-a22a-57e0c1e880b9 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] [instance: f0c5fb50-4991-45b2-803d-7bcfe51f7c34] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:05:24.004234 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-900eb49e-ee56-4a13-a22a-57e0c1e880b9 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:05:24.005005 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-900eb49e-ee56-4a13-a22a-57e0c1e880b9 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:05:24.006184 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-900eb49e-ee56-4a13-a22a-57e0c1e880b9 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:05:24.006956 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-900eb49e-ee56-4a13-a22a-57e0c1e880b9 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:05:24.188997 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-900eb49e-ee56-4a13-a22a-57e0c1e880b9 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8622ec5212c84d87b9b7c8f725012a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0143140d4f649478e36abcee284640c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:05:24.200124 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-900eb49e-ee56-4a13-a22a-57e0c1e880b9 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] 10.222.0.20 "GET /compute/v2.1/servers/f0c5fb50-4991-45b2-803d-7bcfe51f7c34" status: 200 len: 1319 microversion: 2.1 time: 0.211699 Jul 01 04:05:24.201129 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 57/121] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:05:23 2022] GET /compute/v2.1/servers/f0c5fb50-4991-45b2-803d-7bcfe51f7c34 => generated 1319 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:05:24.228409 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-07690cf9-9404-4429-bc2e-599030725538 tempest-DeleteServersTestJSON-285930608 tempest-DeleteServersTestJSON-285930608-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:05:24.229513 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-07690cf9-9404-4429-bc2e-599030725538 tempest-DeleteServersTestJSON-285930608 tempest-DeleteServersTestJSON-285930608-project] [instance: 3858eceb-54a4-4bac-beef-8acd0afafba7] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:05:24.238113 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-07690cf9-9404-4429-bc2e-599030725538 tempest-DeleteServersTestJSON-285930608 tempest-DeleteServersTestJSON-285930608-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:05:24.238653 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-07690cf9-9404-4429-bc2e-599030725538 tempest-DeleteServersTestJSON-285930608 tempest-DeleteServersTestJSON-285930608-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:05:24.239760 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-07690cf9-9404-4429-bc2e-599030725538 tempest-DeleteServersTestJSON-285930608 tempest-DeleteServersTestJSON-285930608-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:05:24.240271 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-07690cf9-9404-4429-bc2e-599030725538 tempest-DeleteServersTestJSON-285930608 tempest-DeleteServersTestJSON-285930608-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:05:24.476692 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-07690cf9-9404-4429-bc2e-599030725538 tempest-DeleteServersTestJSON-285930608 tempest-DeleteServersTestJSON-285930608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab2da92b7e94592b80ef3d7852f51ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb56c390ed7649479455d6dc3904deb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:05:24.495808 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-07690cf9-9404-4429-bc2e-599030725538 tempest-DeleteServersTestJSON-285930608 tempest-DeleteServersTestJSON-285930608-project] 10.222.0.20 "GET /compute/v2.1/servers/3858eceb-54a4-4bac-beef-8acd0afafba7" status: 200 len: 1315 microversion: 2.1 time: 0.272456 Jul 01 04:05:24.502444 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 65/122] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:05:24 2022] GET /compute/v2.1/servers/3858eceb-54a4-4bac-beef-8acd0afafba7 => generated 1315 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:05:24.879902 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-bf16a252-db6a-4047-80aa-1c2042a489c8 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:05:24.880518 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-bf16a252-db6a-4047-80aa-1c2042a489c8 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] [instance: b904f233-887c-4c96-a2d2-f7f415ad852f] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:05:24.888338 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-bf16a252-db6a-4047-80aa-1c2042a489c8 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:05:24.888668 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-bf16a252-db6a-4047-80aa-1c2042a489c8 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:05:24.889456 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-bf16a252-db6a-4047-80aa-1c2042a489c8 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:05:24.889901 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-bf16a252-db6a-4047-80aa-1c2042a489c8 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:05:25.033695 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [req-e4d748be-56b7-4fa5-ae92-a424e1d9b82e req-73b20f04-9bf0-4fec-9bf2-761f0d41e87d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f0c5fb50-4991-45b2-803d-7bcfe51f7c34", "name": "network-vif-plugged", "status": "completed", "tag": "36a5bee1-6336-437a-af48-b9f466c3f69d"}]} {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 04:05:25.065393 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [req-e4d748be-56b7-4fa5-ae92-a424e1d9b82e req-73b20f04-9bf0-4fec-9bf2-761f0d41e87d service nova] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:05:25.066238 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [req-e4d748be-56b7-4fa5-ae92-a424e1d9b82e req-73b20f04-9bf0-4fec-9bf2-761f0d41e87d service nova] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:05:25.093096 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.compute.server_external_events [req-e4d748be-56b7-4fa5-ae92-a424e1d9b82e req-73b20f04-9bf0-4fec-9bf2-761f0d41e87d service nova] Creating event network-vif-plugged:36a5bee1-6336-437a-af48-b9f466c3f69d for instance f0c5fb50-4991-45b2-803d-7bcfe51f7c34 on hv-cinder-84684 Jul 01 04:05:25.100742 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [req-e4d748be-56b7-4fa5-ae92-a424e1d9b82e req-73b20f04-9bf0-4fec-9bf2-761f0d41e87d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075362 Jul 01 04:05:25.101639 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 66/123] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Jul 1 04:05:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 04:05:25.136958 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-bf16a252-db6a-4047-80aa-1c2042a489c8 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:05:25.148089 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-bf16a252-db6a-4047-80aa-1c2042a489c8 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:05:25.150481 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-bf16a252-db6a-4047-80aa-1c2042a489c8 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:05:25.152325 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-bf16a252-db6a-4047-80aa-1c2042a489c8 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] 10.222.0.20 "GET /compute/v2.1/servers/b904f233-887c-4c96-a2d2-f7f415ad852f" status: 200 len: 1408 microversion: 2.20 time: 0.277883 Jul 01 04:05:25.162049 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 58/124] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Jul 1 04:05:24 2022] GET /compute/v2.1/servers/b904f233-887c-4c96-a2d2-f7f415ad852f => generated 1408 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 01 04:05:25.222626 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-fd7ebb78-ea8f-46ea-b586-75b832fc2787 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:05:25.223836 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-fd7ebb78-ea8f-46ea-b586-75b832fc2787 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] [instance: f0c5fb50-4991-45b2-803d-7bcfe51f7c34] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:05:25.237034 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-fd7ebb78-ea8f-46ea-b586-75b832fc2787 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:05:25.238190 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-fd7ebb78-ea8f-46ea-b586-75b832fc2787 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:05:25.240480 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-fd7ebb78-ea8f-46ea-b586-75b832fc2787 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:05:25.241624 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-fd7ebb78-ea8f-46ea-b586-75b832fc2787 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:05:25.288480 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG dbcounter [-] [118712] Writing DB stats nova_cell1:SELECT=100 {{(pid=118712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:05:25.521775 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-26d974aa-1c1a-44b8-a76f-06ebf2689b95 tempest-DeleteServersTestJSON-285930608 tempest-DeleteServersTestJSON-285930608-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:05:25.530616 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-fd7ebb78-ea8f-46ea-b586-75b832fc2787 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8622ec5212c84d87b9b7c8f725012a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0143140d4f649478e36abcee284640c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:05:25.532062 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-26d974aa-1c1a-44b8-a76f-06ebf2689b95 tempest-DeleteServersTestJSON-285930608 tempest-DeleteServersTestJSON-285930608-project] [instance: 3858eceb-54a4-4bac-beef-8acd0afafba7] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:05:25.550464 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-26d974aa-1c1a-44b8-a76f-06ebf2689b95 tempest-DeleteServersTestJSON-285930608 tempest-DeleteServersTestJSON-285930608-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:05:25.552052 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-26d974aa-1c1a-44b8-a76f-06ebf2689b95 tempest-DeleteServersTestJSON-285930608 tempest-DeleteServersTestJSON-285930608-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:05:25.555441 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-26d974aa-1c1a-44b8-a76f-06ebf2689b95 tempest-DeleteServersTestJSON-285930608 tempest-DeleteServersTestJSON-285930608-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:05:25.556223 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-26d974aa-1c1a-44b8-a76f-06ebf2689b95 tempest-DeleteServersTestJSON-285930608 tempest-DeleteServersTestJSON-285930608-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:05:25.572743 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-fd7ebb78-ea8f-46ea-b586-75b832fc2787 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] 10.222.0.20 "GET /compute/v2.1/servers/f0c5fb50-4991-45b2-803d-7bcfe51f7c34" status: 200 len: 1319 microversion: 2.1 time: 0.356484 Jul 01 04:05:25.585190 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 67/125] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:05:25 2022] GET /compute/v2.1/servers/f0c5fb50-4991-45b2-803d-7bcfe51f7c34 => generated 1319 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 04:05:25.979721 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-26d974aa-1c1a-44b8-a76f-06ebf2689b95 tempest-DeleteServersTestJSON-285930608 tempest-DeleteServersTestJSON-285930608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab2da92b7e94592b80ef3d7852f51ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb56c390ed7649479455d6dc3904deb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:05:26.001045 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-26d974aa-1c1a-44b8-a76f-06ebf2689b95 tempest-DeleteServersTestJSON-285930608 tempest-DeleteServersTestJSON-285930608-project] 10.222.0.20 "GET /compute/v2.1/servers/3858eceb-54a4-4bac-beef-8acd0afafba7" status: 200 len: 1315 microversion: 2.1 time: 0.485698 Jul 01 04:05:26.002983 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 59/126] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:05:25 2022] GET /compute/v2.1/servers/3858eceb-54a4-4bac-beef-8acd0afafba7 => generated 1315 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:05:26.183844 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-de6d340e-f220-4c7d-891e-30c752cfd6bd tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:05:26.184758 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-de6d340e-f220-4c7d-891e-30c752cfd6bd tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] [instance: b904f233-887c-4c96-a2d2-f7f415ad852f] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:05:26.193126 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-de6d340e-f220-4c7d-891e-30c752cfd6bd tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:05:26.193953 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-de6d340e-f220-4c7d-891e-30c752cfd6bd tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:05:26.195914 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-de6d340e-f220-4c7d-891e-30c752cfd6bd tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:05:26.196454 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-de6d340e-f220-4c7d-891e-30c752cfd6bd tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:05:26.423104 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-de6d340e-f220-4c7d-891e-30c752cfd6bd tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:05:26.451713 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-de6d340e-f220-4c7d-891e-30c752cfd6bd tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:05:26.455403 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-de6d340e-f220-4c7d-891e-30c752cfd6bd tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:05:26.455403 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-de6d340e-f220-4c7d-891e-30c752cfd6bd tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] 10.222.0.20 "GET /compute/v2.1/servers/b904f233-887c-4c96-a2d2-f7f415ad852f" status: 200 len: 1408 microversion: 2.20 time: 0.275814 Jul 01 04:05:26.465675 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 68/127] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Jul 1 04:05:26 2022] GET /compute/v2.1/servers/b904f233-887c-4c96-a2d2-f7f415ad852f => generated 1408 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 04:05:26.609717 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-9cf17a41-8cae-4bb6-bd9c-31f9e826e3d9 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:05:26.610840 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-9cf17a41-8cae-4bb6-bd9c-31f9e826e3d9 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] [instance: f0c5fb50-4991-45b2-803d-7bcfe51f7c34] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:05:26.643350 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-9cf17a41-8cae-4bb6-bd9c-31f9e826e3d9 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:05:26.644045 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-9cf17a41-8cae-4bb6-bd9c-31f9e826e3d9 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:05:26.644937 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-9cf17a41-8cae-4bb6-bd9c-31f9e826e3d9 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:05:26.646938 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-9cf17a41-8cae-4bb6-bd9c-31f9e826e3d9 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:05:26.885260 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-9cf17a41-8cae-4bb6-bd9c-31f9e826e3d9 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8622ec5212c84d87b9b7c8f725012a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0143140d4f649478e36abcee284640c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:05:26.899008 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-9cf17a41-8cae-4bb6-bd9c-31f9e826e3d9 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] 10.222.0.20 "GET /compute/v2.1/servers/f0c5fb50-4991-45b2-803d-7bcfe51f7c34" status: 200 len: 1319 microversion: 2.1 time: 0.298302 Jul 01 04:05:26.900296 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 60/128] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:05:26 2022] GET /compute/v2.1/servers/f0c5fb50-4991-45b2-803d-7bcfe51f7c34 => generated 1319 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:05:27.022299 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-80db7369-4428-4313-8706-c38fc3c4ebfc tempest-DeleteServersTestJSON-285930608 tempest-DeleteServersTestJSON-285930608-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:05:27.023024 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-80db7369-4428-4313-8706-c38fc3c4ebfc tempest-DeleteServersTestJSON-285930608 tempest-DeleteServersTestJSON-285930608-project] [instance: 3858eceb-54a4-4bac-beef-8acd0afafba7] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:05:27.047978 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-80db7369-4428-4313-8706-c38fc3c4ebfc tempest-DeleteServersTestJSON-285930608 tempest-DeleteServersTestJSON-285930608-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:05:27.047978 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-80db7369-4428-4313-8706-c38fc3c4ebfc tempest-DeleteServersTestJSON-285930608 tempest-DeleteServersTestJSON-285930608-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:05:27.047978 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-80db7369-4428-4313-8706-c38fc3c4ebfc tempest-DeleteServersTestJSON-285930608 tempest-DeleteServersTestJSON-285930608-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:05:27.047978 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-80db7369-4428-4313-8706-c38fc3c4ebfc tempest-DeleteServersTestJSON-285930608 tempest-DeleteServersTestJSON-285930608-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:05:27.125507 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [req-31bfe183-ec8e-441c-a9fe-a2036efce30d req-f872507d-09af-4c14-8e7c-a0ea4e36748e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd6bb9ca-aa57-4dc3-98bc-8e3194003673", "name": "network-vif-plugged", "status": "completed", "tag": "733c3087-abf2-445f-b346-a1bea93c6bdb"}, {"server_uuid": "b904f233-887c-4c96-a2d2-f7f415ad852f", "name": "network-vif-plugged", "status": "completed", "tag": "b1d88871-2b18-4397-8234-7831054c30f0"}]} {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 04:05:27.166618 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [req-31bfe183-ec8e-441c-a9fe-a2036efce30d req-f872507d-09af-4c14-8e7c-a0ea4e36748e service nova] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:05:27.171436 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [req-31bfe183-ec8e-441c-a9fe-a2036efce30d req-f872507d-09af-4c14-8e7c-a0ea4e36748e service nova] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:05:27.223017 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.compute.server_external_events [req-31bfe183-ec8e-441c-a9fe-a2036efce30d req-f872507d-09af-4c14-8e7c-a0ea4e36748e service nova] Creating event network-vif-plugged:733c3087-abf2-445f-b346-a1bea93c6bdb for instance cd6bb9ca-aa57-4dc3-98bc-8e3194003673 on hv-cinder-84684 Jul 01 04:05:27.223737 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.compute.server_external_events [req-31bfe183-ec8e-441c-a9fe-a2036efce30d req-f872507d-09af-4c14-8e7c-a0ea4e36748e service nova] Creating event network-vif-plugged:b1d88871-2b18-4397-8234-7831054c30f0 for instance b904f233-887c-4c96-a2d2-f7f415ad852f on hv-cinder-84684 Jul 01 04:05:27.232122 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [req-31bfe183-ec8e-441c-a9fe-a2036efce30d req-f872507d-09af-4c14-8e7c-a0ea4e36748e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.114292 Jul 01 04:05:27.239372 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 61/129] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Jul 1 04:05:27 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 04:05:27.350804 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-80db7369-4428-4313-8706-c38fc3c4ebfc tempest-DeleteServersTestJSON-285930608 tempest-DeleteServersTestJSON-285930608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab2da92b7e94592b80ef3d7852f51ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb56c390ed7649479455d6dc3904deb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:05:27.362744 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-80db7369-4428-4313-8706-c38fc3c4ebfc tempest-DeleteServersTestJSON-285930608 tempest-DeleteServersTestJSON-285930608-project] 10.222.0.20 "GET /compute/v2.1/servers/3858eceb-54a4-4bac-beef-8acd0afafba7" status: 200 len: 1503 microversion: 2.1 time: 0.345158 Jul 01 04:05:27.364840 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 69/130] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:05:27 2022] GET /compute/v2.1/servers/3858eceb-54a4-4bac-beef-8acd0afafba7 => generated 1503 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:05:27.494331 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-958582d8-2723-420b-af27-bf28f162b29a tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:05:27.495873 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-958582d8-2723-420b-af27-bf28f162b29a tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] [instance: b904f233-887c-4c96-a2d2-f7f415ad852f] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:05:27.507124 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-958582d8-2723-420b-af27-bf28f162b29a tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:05:27.508315 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-958582d8-2723-420b-af27-bf28f162b29a tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:05:27.509896 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-958582d8-2723-420b-af27-bf28f162b29a tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:05:27.510899 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-958582d8-2723-420b-af27-bf28f162b29a tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:05:27.964306 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-958582d8-2723-420b-af27-bf28f162b29a tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:05:27.964306 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-958582d8-2723-420b-af27-bf28f162b29a tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:05:27.965613 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-958582d8-2723-420b-af27-bf28f162b29a tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:05:27.965613 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-958582d8-2723-420b-af27-bf28f162b29a tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] 10.222.0.20 "GET /compute/v2.1/servers/b904f233-887c-4c96-a2d2-f7f415ad852f" status: 200 len: 1408 microversion: 2.20 time: 0.360039 Jul 01 04:05:27.965613 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 62/131] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Jul 1 04:05:27 2022] GET /compute/v2.1/servers/b904f233-887c-4c96-a2d2-f7f415ad852f => generated 1408 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 04:05:27.966306 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-fee7efc6-ef07-4038-8385-d4d218c82f12 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:05:27.966306 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-fee7efc6-ef07-4038-8385-d4d218c82f12 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] [instance: f0c5fb50-4991-45b2-803d-7bcfe51f7c34] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:05:27.966306 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-fee7efc6-ef07-4038-8385-d4d218c82f12 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:05:27.966306 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-fee7efc6-ef07-4038-8385-d4d218c82f12 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:05:27.966620 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-fee7efc6-ef07-4038-8385-d4d218c82f12 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:05:27.966620 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-fee7efc6-ef07-4038-8385-d4d218c82f12 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:05:28.117046 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-fee7efc6-ef07-4038-8385-d4d218c82f12 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8622ec5212c84d87b9b7c8f725012a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0143140d4f649478e36abcee284640c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:05:28.125761 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-fee7efc6-ef07-4038-8385-d4d218c82f12 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] 10.222.0.20 "GET /compute/v2.1/servers/f0c5fb50-4991-45b2-803d-7bcfe51f7c34" status: 200 len: 1513 microversion: 2.1 time: 0.206572 Jul 01 04:05:28.126393 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 70/132] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:05:27 2022] GET /compute/v2.1/servers/f0c5fb50-4991-45b2-803d-7bcfe51f7c34 => generated 1513 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:05:28.144253 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-d4084a2d-7920-4823-ac26-b529adf6bd97 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 04:05:28.145282 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-d4084a2d-7920-4823-ac26-b529adf6bd97 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] [instance: f0c5fb50-4991-45b2-803d-7bcfe51f7c34] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:05:28.152098 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-d4084a2d-7920-4823-ac26-b529adf6bd97 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:05:28.152553 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-d4084a2d-7920-4823-ac26-b529adf6bd97 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:05:28.153337 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-d4084a2d-7920-4823-ac26-b529adf6bd97 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:05:28.153795 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-d4084a2d-7920-4823-ac26-b529adf6bd97 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:05:28.222086 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.objects.instance [None req-d4084a2d-7920-4823-ac26-b529adf6bd97 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lazy-loading 'flavor' on Instance uuid f0c5fb50-4991-45b2-803d-7bcfe51f7c34 {{(pid=118711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 04:05:28.776766 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-d4084a2d-7920-4823-ac26-b529adf6bd97 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] 10.222.0.20 "POST /compute/v2.1/servers/f0c5fb50-4991-45b2-803d-7bcfe51f7c34/action" status: 200 len: 32 microversion: 2.1 time: 0.636893 Jul 01 04:05:28.777790 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 63/133] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Jul 1 04:05:28 2022] POST /compute/v2.1/servers/f0c5fb50-4991-45b2-803d-7bcfe51f7c34/action => generated 32 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 01 04:05:28.791891 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-01407e04-25df-40f2-a83b-553c04940924 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:05:28.793953 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-01407e04-25df-40f2-a83b-553c04940924 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] [instance: f0c5fb50-4991-45b2-803d-7bcfe51f7c34] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:05:28.805890 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-01407e04-25df-40f2-a83b-553c04940924 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:05:28.806447 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-01407e04-25df-40f2-a83b-553c04940924 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:05:28.807740 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-01407e04-25df-40f2-a83b-553c04940924 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:05:28.808238 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-01407e04-25df-40f2-a83b-553c04940924 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:05:28.867645 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-41f1b9ed-e956-4684-b944-67f77b0be9c2 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:05:28.870228 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-41f1b9ed-e956-4684-b944-67f77b0be9c2 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] [instance: b904f233-887c-4c96-a2d2-f7f415ad852f] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:05:28.894656 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-41f1b9ed-e956-4684-b944-67f77b0be9c2 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:05:28.895774 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-41f1b9ed-e956-4684-b944-67f77b0be9c2 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:05:28.906011 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-41f1b9ed-e956-4684-b944-67f77b0be9c2 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:05:28.906011 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-41f1b9ed-e956-4684-b944-67f77b0be9c2 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:05:29.267648 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-41f1b9ed-e956-4684-b944-67f77b0be9c2 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:05:29.282426 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-41f1b9ed-e956-4684-b944-67f77b0be9c2 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:05:29.284767 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-41f1b9ed-e956-4684-b944-67f77b0be9c2 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:05:29.290875 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-41f1b9ed-e956-4684-b944-67f77b0be9c2 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] 10.222.0.20 "GET /compute/v2.1/servers/b904f233-887c-4c96-a2d2-f7f415ad852f" status: 200 len: 1408 microversion: 2.20 time: 0.425795 Jul 01 04:05:29.290875 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 64/134] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Jul 1 04:05:28 2022] GET /compute/v2.1/servers/b904f233-887c-4c96-a2d2-f7f415ad852f => generated 1408 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 04:05:29.302068 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-01407e04-25df-40f2-a83b-553c04940924 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8622ec5212c84d87b9b7c8f725012a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0143140d4f649478e36abcee284640c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:05:29.311016 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-01407e04-25df-40f2-a83b-553c04940924 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] 10.222.0.20 "GET /compute/v2.1/servers/f0c5fb50-4991-45b2-803d-7bcfe51f7c34" status: 200 len: 1519 microversion: 2.1 time: 0.525234 Jul 01 04:05:29.311764 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 71/135] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:05:28 2022] GET /compute/v2.1/servers/f0c5fb50-4991-45b2-803d-7bcfe51f7c34 => generated 1519 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:05:30.316152 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-af84d633-b4ae-4bf6-b991-496bb72413fa tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:05:30.317288 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-af84d633-b4ae-4bf6-b991-496bb72413fa tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] [instance: b904f233-887c-4c96-a2d2-f7f415ad852f] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:05:30.330461 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-af84d633-b4ae-4bf6-b991-496bb72413fa tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:05:30.331286 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-af84d633-b4ae-4bf6-b991-496bb72413fa tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:05:30.332722 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-af84d633-b4ae-4bf6-b991-496bb72413fa tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:05:30.333529 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-af84d633-b4ae-4bf6-b991-496bb72413fa tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:05:30.334396 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-15849dfd-e615-410e-9529-b4c7600bdde7 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:05:30.335575 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-15849dfd-e615-410e-9529-b4c7600bdde7 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] [instance: f0c5fb50-4991-45b2-803d-7bcfe51f7c34] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:05:30.347825 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-15849dfd-e615-410e-9529-b4c7600bdde7 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:05:30.347825 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-15849dfd-e615-410e-9529-b4c7600bdde7 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:05:30.349623 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-15849dfd-e615-410e-9529-b4c7600bdde7 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:05:30.350585 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-15849dfd-e615-410e-9529-b4c7600bdde7 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:05:30.610861 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-af84d633-b4ae-4bf6-b991-496bb72413fa tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:05:30.626983 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-af84d633-b4ae-4bf6-b991-496bb72413fa tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:05:30.630818 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-af84d633-b4ae-4bf6-b991-496bb72413fa tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:05:30.633053 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-af84d633-b4ae-4bf6-b991-496bb72413fa tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] 10.222.0.20 "GET /compute/v2.1/servers/b904f233-887c-4c96-a2d2-f7f415ad852f" status: 200 len: 1408 microversion: 2.20 time: 0.325156 Jul 01 04:05:30.634075 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 65/136] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Jul 1 04:05:30 2022] GET /compute/v2.1/servers/b904f233-887c-4c96-a2d2-f7f415ad852f => generated 1408 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 04:05:30.796349 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-15849dfd-e615-410e-9529-b4c7600bdde7 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8622ec5212c84d87b9b7c8f725012a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0143140d4f649478e36abcee284640c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:05:30.808998 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-15849dfd-e615-410e-9529-b4c7600bdde7 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] 10.222.0.20 "GET /compute/v2.1/servers/f0c5fb50-4991-45b2-803d-7bcfe51f7c34" status: 200 len: 1519 microversion: 2.1 time: 0.482507 Jul 01 04:05:30.809680 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 72/137] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:05:30 2022] GET /compute/v2.1/servers/f0c5fb50-4991-45b2-803d-7bcfe51f7c34 => generated 1519 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 04:05:30.871390 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-46bc587f-c7b5-438e-9ac1-c5964400dec6 tempest-DeleteServersTestJSON-285930608 tempest-DeleteServersTestJSON-285930608-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e948edb1-be4d-40d7-81b3-95b75030603f"}} {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 04:05:30.872686 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-46bc587f-c7b5-438e-9ac1-c5964400dec6 tempest-DeleteServersTestJSON-285930608 tempest-DeleteServersTestJSON-285930608-project] [instance: 3858eceb-54a4-4bac-beef-8acd0afafba7] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:05:30.901220 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-46bc587f-c7b5-438e-9ac1-c5964400dec6 tempest-DeleteServersTestJSON-285930608 tempest-DeleteServersTestJSON-285930608-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:05:30.902138 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-46bc587f-c7b5-438e-9ac1-c5964400dec6 tempest-DeleteServersTestJSON-285930608 tempest-DeleteServersTestJSON-285930608-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:05:30.902962 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-46bc587f-c7b5-438e-9ac1-c5964400dec6 tempest-DeleteServersTestJSON-285930608 tempest-DeleteServersTestJSON-285930608-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:05:30.903593 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-46bc587f-c7b5-438e-9ac1-c5964400dec6 tempest-DeleteServersTestJSON-285930608 tempest-DeleteServersTestJSON-285930608-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:05:31.674723 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-e2ef1d48-525f-422b-998f-793d5c4bfdf4 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:05:31.674723 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-e2ef1d48-525f-422b-998f-793d5c4bfdf4 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] [instance: b904f233-887c-4c96-a2d2-f7f415ad852f] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:05:31.709202 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-e2ef1d48-525f-422b-998f-793d5c4bfdf4 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:05:31.709202 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-e2ef1d48-525f-422b-998f-793d5c4bfdf4 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:05:31.711602 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-e2ef1d48-525f-422b-998f-793d5c4bfdf4 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:05:31.712908 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-e2ef1d48-525f-422b-998f-793d5c4bfdf4 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:05:31.940524 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-e2ef1d48-525f-422b-998f-793d5c4bfdf4 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:05:31.953559 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-e2ef1d48-525f-422b-998f-793d5c4bfdf4 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:05:31.953559 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-e2ef1d48-525f-422b-998f-793d5c4bfdf4 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:05:31.953559 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-e2ef1d48-525f-422b-998f-793d5c4bfdf4 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] 10.222.0.20 "GET /compute/v2.1/servers/b904f233-887c-4c96-a2d2-f7f415ad852f" status: 200 len: 1599 microversion: 2.20 time: 0.304250 Jul 01 04:05:31.954104 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 73/138] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Jul 1 04:05:31 2022] GET /compute/v2.1/servers/b904f233-887c-4c96-a2d2-f7f415ad852f => generated 1599 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 01 04:05:31.959316 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-8875daf4-b525-4468-9fa8-a7dcfd819820 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:05:31.960089 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-8875daf4-b525-4468-9fa8-a7dcfd819820 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] [instance: f0c5fb50-4991-45b2-803d-7bcfe51f7c34] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:05:31.967745 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-8875daf4-b525-4468-9fa8-a7dcfd819820 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:05:31.968232 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-8875daf4-b525-4468-9fa8-a7dcfd819820 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:05:31.969632 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-8875daf4-b525-4468-9fa8-a7dcfd819820 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:05:31.970376 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-8875daf4-b525-4468-9fa8-a7dcfd819820 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:05:32.190622 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-8875daf4-b525-4468-9fa8-a7dcfd819820 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8622ec5212c84d87b9b7c8f725012a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0143140d4f649478e36abcee284640c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:05:32.215085 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-8875daf4-b525-4468-9fa8-a7dcfd819820 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] 10.222.0.20 "GET /compute/v2.1/servers/f0c5fb50-4991-45b2-803d-7bcfe51f7c34" status: 200 len: 1519 microversion: 2.1 time: 0.259942 Jul 01 04:05:32.216656 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 74/139] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:05:31 2022] GET /compute/v2.1/servers/f0c5fb50-4991-45b2-803d-7bcfe51f7c34 => generated 1519 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:05:32.226859 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-e6075508-3b00-478a-bcc5-109e16ae2de6 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:05:32.227714 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-e6075508-3b00-478a-bcc5-109e16ae2de6 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] [instance: b904f233-887c-4c96-a2d2-f7f415ad852f] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:05:32.241321 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-e6075508-3b00-478a-bcc5-109e16ae2de6 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:05:32.242137 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-e6075508-3b00-478a-bcc5-109e16ae2de6 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:05:32.243852 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-e6075508-3b00-478a-bcc5-109e16ae2de6 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:05:32.244217 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-e6075508-3b00-478a-bcc5-109e16ae2de6 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:05:32.428803 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-e6075508-3b00-478a-bcc5-109e16ae2de6 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] 10.222.0.20 "GET /compute/v2.1/servers/b904f233-887c-4c96-a2d2-f7f415ad852f/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.210175 Jul 01 04:05:32.435640 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 75/140] 10.222.0.20 () {60 vars in 1315 bytes} [Fri Jul 1 04:05:32 2022] GET /compute/v2.1/servers/b904f233-887c-4c96-a2d2-f7f415ad852f/os-interface => generated 284 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 01 04:05:32.556054 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-46bc587f-c7b5-438e-9ac1-c5964400dec6 tempest-DeleteServersTestJSON-285930608 tempest-DeleteServersTestJSON-285930608-project] 10.222.0.20 "POST /compute/v2.1/servers/3858eceb-54a4-4bac-beef-8acd0afafba7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.693319 Jul 01 04:05:32.571062 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 66/141] 10.222.0.20 () {60 vars in 1322 bytes} [Fri Jul 1 04:05:30 2022] POST /compute/v2.1/servers/3858eceb-54a4-4bac-beef-8acd0afafba7/os-volume_attachments => generated 194 bytes in 1710 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 04:05:33.239520 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-1470d491-0255-4422-8fb3-f0baa83852e1 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:05:33.241833 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-1470d491-0255-4422-8fb3-f0baa83852e1 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] [instance: f0c5fb50-4991-45b2-803d-7bcfe51f7c34] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:05:33.255517 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-1470d491-0255-4422-8fb3-f0baa83852e1 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:05:33.256289 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-1470d491-0255-4422-8fb3-f0baa83852e1 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:05:33.258212 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-1470d491-0255-4422-8fb3-f0baa83852e1 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:05:33.259527 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-1470d491-0255-4422-8fb3-f0baa83852e1 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:05:33.752973 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-1470d491-0255-4422-8fb3-f0baa83852e1 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8622ec5212c84d87b9b7c8f725012a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0143140d4f649478e36abcee284640c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:05:33.768351 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-1470d491-0255-4422-8fb3-f0baa83852e1 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] 10.222.0.20 "GET /compute/v2.1/servers/f0c5fb50-4991-45b2-803d-7bcfe51f7c34" status: 200 len: 1519 microversion: 2.1 time: 0.536806 Jul 01 04:05:33.794332 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 76/142] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:05:33 2022] GET /compute/v2.1/servers/f0c5fb50-4991-45b2-803d-7bcfe51f7c34 => generated 1519 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:05:34.662033 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [req-71ab0c30-f3af-43bb-8538-6e46eff7a9be req-06bde7b7-8588-4a94-aab4-2f17f620e8f4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b904f233-887c-4c96-a2d2-f7f415ad852f", "tag": "b1d88871-2b18-4397-8234-7831054c30f0"}]} {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 04:05:34.671145 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG dbcounter [-] [118711] Writing DB stats nova_cell0:SELECT=2 {{(pid=118711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:05:34.683113 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [req-71ab0c30-f3af-43bb-8538-6e46eff7a9be req-06bde7b7-8588-4a94-aab4-2f17f620e8f4 service nova] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:05:34.684402 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [req-71ab0c30-f3af-43bb-8538-6e46eff7a9be req-06bde7b7-8588-4a94-aab4-2f17f620e8f4 service nova] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:05:34.713728 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.compute.server_external_events [req-71ab0c30-f3af-43bb-8538-6e46eff7a9be req-06bde7b7-8588-4a94-aab4-2f17f620e8f4 service nova] Creating event network-changed:b1d88871-2b18-4397-8234-7831054c30f0 for instance b904f233-887c-4c96-a2d2-f7f415ad852f on hv-cinder-84684 Jul 01 04:05:34.724002 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [req-71ab0c30-f3af-43bb-8538-6e46eff7a9be req-06bde7b7-8588-4a94-aab4-2f17f620e8f4 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069870 Jul 01 04:05:34.728133 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 67/143] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Jul 1 04:05:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 04:05:34.798312 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-e44d9a3b-039c-4b7b-9d54-4d15fee70292 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:05:34.798965 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-e44d9a3b-039c-4b7b-9d54-4d15fee70292 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] [instance: f0c5fb50-4991-45b2-803d-7bcfe51f7c34] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:05:34.810843 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-e44d9a3b-039c-4b7b-9d54-4d15fee70292 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:05:34.811353 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-e44d9a3b-039c-4b7b-9d54-4d15fee70292 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:05:34.813842 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-e44d9a3b-039c-4b7b-9d54-4d15fee70292 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:05:34.814318 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-e44d9a3b-039c-4b7b-9d54-4d15fee70292 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:05:35.185740 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-e44d9a3b-039c-4b7b-9d54-4d15fee70292 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8622ec5212c84d87b9b7c8f725012a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0143140d4f649478e36abcee284640c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:05:35.203967 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-e44d9a3b-039c-4b7b-9d54-4d15fee70292 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] 10.222.0.20 "GET /compute/v2.1/servers/f0c5fb50-4991-45b2-803d-7bcfe51f7c34" status: 200 len: 1519 microversion: 2.1 time: 0.411097 Jul 01 04:05:35.206297 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 77/144] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:05:34 2022] GET /compute/v2.1/servers/f0c5fb50-4991-45b2-803d-7bcfe51f7c34 => generated 1519 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:05:36.227216 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-37df0e1d-51d5-4f97-865f-eb22886d6167 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:05:36.230001 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-37df0e1d-51d5-4f97-865f-eb22886d6167 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] [instance: f0c5fb50-4991-45b2-803d-7bcfe51f7c34] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:05:36.243731 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-37df0e1d-51d5-4f97-865f-eb22886d6167 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:05:36.245013 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-37df0e1d-51d5-4f97-865f-eb22886d6167 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:05:36.246810 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-37df0e1d-51d5-4f97-865f-eb22886d6167 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:05:36.247729 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-37df0e1d-51d5-4f97-865f-eb22886d6167 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:05:36.693369 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-37df0e1d-51d5-4f97-865f-eb22886d6167 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8622ec5212c84d87b9b7c8f725012a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0143140d4f649478e36abcee284640c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:05:36.702306 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-37df0e1d-51d5-4f97-865f-eb22886d6167 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] 10.222.0.20 "GET /compute/v2.1/servers/f0c5fb50-4991-45b2-803d-7bcfe51f7c34" status: 200 len: 1519 microversion: 2.1 time: 0.483351 Jul 01 04:05:36.715816 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 68/145] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:05:36 2022] GET /compute/v2.1/servers/f0c5fb50-4991-45b2-803d-7bcfe51f7c34 => generated 1519 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:05:37.725853 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-2006d0b0-3b78-45b2-9b84-3e957d6ae33c tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:05:37.726916 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-2006d0b0-3b78-45b2-9b84-3e957d6ae33c tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] [instance: f0c5fb50-4991-45b2-803d-7bcfe51f7c34] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:05:37.736091 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-2006d0b0-3b78-45b2-9b84-3e957d6ae33c tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:05:37.737133 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-2006d0b0-3b78-45b2-9b84-3e957d6ae33c tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:05:37.739559 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-2006d0b0-3b78-45b2-9b84-3e957d6ae33c tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:05:37.740561 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-2006d0b0-3b78-45b2-9b84-3e957d6ae33c tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:05:37.957700 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-2006d0b0-3b78-45b2-9b84-3e957d6ae33c tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8622ec5212c84d87b9b7c8f725012a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0143140d4f649478e36abcee284640c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:05:37.965678 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-2006d0b0-3b78-45b2-9b84-3e957d6ae33c tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] 10.222.0.20 "GET /compute/v2.1/servers/f0c5fb50-4991-45b2-803d-7bcfe51f7c34" status: 200 len: 1519 microversion: 2.1 time: 0.246804 Jul 01 04:05:37.966285 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 78/146] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:05:37 2022] GET /compute/v2.1/servers/f0c5fb50-4991-45b2-803d-7bcfe51f7c34 => generated 1519 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:05:38.986184 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-2983aa6a-c764-4014-95ef-0cacf7a6aacc tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:05:38.986960 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-2983aa6a-c764-4014-95ef-0cacf7a6aacc tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] [instance: f0c5fb50-4991-45b2-803d-7bcfe51f7c34] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:05:38.989643 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG dbcounter [-] [118711] Writing DB stats nova_api:SELECT=63 {{(pid=118711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:05:38.997853 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-2983aa6a-c764-4014-95ef-0cacf7a6aacc tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:05:38.998788 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-2983aa6a-c764-4014-95ef-0cacf7a6aacc tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:05:39.000596 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-2983aa6a-c764-4014-95ef-0cacf7a6aacc tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:05:39.001332 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-2983aa6a-c764-4014-95ef-0cacf7a6aacc tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:05:39.305241 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-2983aa6a-c764-4014-95ef-0cacf7a6aacc tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8622ec5212c84d87b9b7c8f725012a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0143140d4f649478e36abcee284640c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:05:39.317825 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-2983aa6a-c764-4014-95ef-0cacf7a6aacc tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] 10.222.0.20 "GET /compute/v2.1/servers/f0c5fb50-4991-45b2-803d-7bcfe51f7c34" status: 200 len: 1519 microversion: 2.1 time: 0.334243 Jul 01 04:05:39.332216 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 69/147] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:05:38 2022] GET /compute/v2.1/servers/f0c5fb50-4991-45b2-803d-7bcfe51f7c34 => generated 1519 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:05:40.345568 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-2aeac11c-7c30-47c9-be92-6037a569b1f4 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:05:40.346742 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-2aeac11c-7c30-47c9-be92-6037a569b1f4 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] [instance: f0c5fb50-4991-45b2-803d-7bcfe51f7c34] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:05:40.353055 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-2aeac11c-7c30-47c9-be92-6037a569b1f4 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:05:40.353511 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-2aeac11c-7c30-47c9-be92-6037a569b1f4 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:05:40.354286 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-2aeac11c-7c30-47c9-be92-6037a569b1f4 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:05:40.354890 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-2aeac11c-7c30-47c9-be92-6037a569b1f4 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:05:40.528843 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-2aeac11c-7c30-47c9-be92-6037a569b1f4 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8622ec5212c84d87b9b7c8f725012a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0143140d4f649478e36abcee284640c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:05:40.539486 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-2aeac11c-7c30-47c9-be92-6037a569b1f4 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] 10.222.0.20 "GET /compute/v2.1/servers/f0c5fb50-4991-45b2-803d-7bcfe51f7c34" status: 200 len: 1519 microversion: 2.1 time: 0.201329 Jul 01 04:05:40.540236 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 79/148] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:05:40 2022] GET /compute/v2.1/servers/f0c5fb50-4991-45b2-803d-7bcfe51f7c34 => generated 1519 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:05:41.564976 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-cb75291e-c7ed-4516-876a-092040aa4f40 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:05:41.565676 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-cb75291e-c7ed-4516-876a-092040aa4f40 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] [instance: f0c5fb50-4991-45b2-803d-7bcfe51f7c34] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:05:41.572851 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-cb75291e-c7ed-4516-876a-092040aa4f40 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:05:41.573561 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-cb75291e-c7ed-4516-876a-092040aa4f40 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:05:41.574485 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-cb75291e-c7ed-4516-876a-092040aa4f40 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:05:41.574995 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-cb75291e-c7ed-4516-876a-092040aa4f40 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:05:41.735124 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-cb75291e-c7ed-4516-876a-092040aa4f40 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8622ec5212c84d87b9b7c8f725012a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0143140d4f649478e36abcee284640c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:05:41.749277 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-cb75291e-c7ed-4516-876a-092040aa4f40 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] 10.222.0.20 "GET /compute/v2.1/servers/f0c5fb50-4991-45b2-803d-7bcfe51f7c34" status: 200 len: 1519 microversion: 2.1 time: 0.189542 Jul 01 04:05:41.750891 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 70/149] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:05:41 2022] GET /compute/v2.1/servers/f0c5fb50-4991-45b2-803d-7bcfe51f7c34 => generated 1519 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:05:42.584043 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-a13282b3-ef92-4057-b9c3-45b779343bab tempest-DeleteServersTestJSON-285930608 tempest-DeleteServersTestJSON-285930608-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:05:42.586728 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-a13282b3-ef92-4057-b9c3-45b779343bab tempest-DeleteServersTestJSON-285930608 tempest-DeleteServersTestJSON-285930608-project] [instance: 3858eceb-54a4-4bac-beef-8acd0afafba7] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:05:42.592455 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG dbcounter [-] [118712] Writing DB stats nova_api:SELECT=66 {{(pid=118712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:05:42.602121 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-a13282b3-ef92-4057-b9c3-45b779343bab tempest-DeleteServersTestJSON-285930608 tempest-DeleteServersTestJSON-285930608-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:05:42.603176 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-a13282b3-ef92-4057-b9c3-45b779343bab tempest-DeleteServersTestJSON-285930608 tempest-DeleteServersTestJSON-285930608-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:05:42.605297 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-a13282b3-ef92-4057-b9c3-45b779343bab tempest-DeleteServersTestJSON-285930608 tempest-DeleteServersTestJSON-285930608-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:05:42.606288 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-a13282b3-ef92-4057-b9c3-45b779343bab tempest-DeleteServersTestJSON-285930608 tempest-DeleteServersTestJSON-285930608-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:05:42.639132 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-a13282b3-ef92-4057-b9c3-45b779343bab tempest-DeleteServersTestJSON-285930608 tempest-DeleteServersTestJSON-285930608-project] [instance: 3858eceb-54a4-4bac-beef-8acd0afafba7] Going to try to terminate instance {{(pid=118712) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 01 04:05:42.770173 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-90b7490a-e024-4e01-9b96-d14f99995c2a tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:05:42.778091 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-90b7490a-e024-4e01-9b96-d14f99995c2a tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] [instance: f0c5fb50-4991-45b2-803d-7bcfe51f7c34] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:05:42.779829 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-90b7490a-e024-4e01-9b96-d14f99995c2a tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:05:42.781061 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-90b7490a-e024-4e01-9b96-d14f99995c2a tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:05:42.782810 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-90b7490a-e024-4e01-9b96-d14f99995c2a tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:05:42.783511 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-90b7490a-e024-4e01-9b96-d14f99995c2a tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:05:42.815176 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG dbcounter [-] [118711] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=118711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:05:42.933181 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-90b7490a-e024-4e01-9b96-d14f99995c2a tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8622ec5212c84d87b9b7c8f725012a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0143140d4f649478e36abcee284640c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:05:42.941379 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-90b7490a-e024-4e01-9b96-d14f99995c2a tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] 10.222.0.20 "GET /compute/v2.1/servers/f0c5fb50-4991-45b2-803d-7bcfe51f7c34" status: 200 len: 1519 microversion: 2.1 time: 0.176382 Jul 01 04:05:42.942020 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 71/150] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:05:42 2022] GET /compute/v2.1/servers/f0c5fb50-4991-45b2-803d-7bcfe51f7c34 => generated 1519 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 04:05:43.022436 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-a13282b3-ef92-4057-b9c3-45b779343bab tempest-DeleteServersTestJSON-285930608 tempest-DeleteServersTestJSON-285930608-project] 10.222.0.20 "DELETE /compute/v2.1/servers/3858eceb-54a4-4bac-beef-8acd0afafba7" status: 204 len: 0 microversion: 2.1 time: 0.445276 Jul 01 04:05:43.023659 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 80/151] 10.222.0.20 () {58 vars in 1238 bytes} [Fri Jul 1 04:05:42 2022] DELETE /compute/v2.1/servers/3858eceb-54a4-4bac-beef-8acd0afafba7 => generated 0 bytes in 448 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 01 04:05:43.034370 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-bcd2985f-ccf3-4274-a374-6167b8649e8b tempest-DeleteServersTestJSON-285930608 tempest-DeleteServersTestJSON-285930608-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:05:43.035016 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-bcd2985f-ccf3-4274-a374-6167b8649e8b tempest-DeleteServersTestJSON-285930608 tempest-DeleteServersTestJSON-285930608-project] [instance: 3858eceb-54a4-4bac-beef-8acd0afafba7] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:05:43.041706 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-bcd2985f-ccf3-4274-a374-6167b8649e8b tempest-DeleteServersTestJSON-285930608 tempest-DeleteServersTestJSON-285930608-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:05:43.042164 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-bcd2985f-ccf3-4274-a374-6167b8649e8b tempest-DeleteServersTestJSON-285930608 tempest-DeleteServersTestJSON-285930608-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:05:43.042957 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-bcd2985f-ccf3-4274-a374-6167b8649e8b tempest-DeleteServersTestJSON-285930608 tempest-DeleteServersTestJSON-285930608-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:05:43.043472 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-bcd2985f-ccf3-4274-a374-6167b8649e8b tempest-DeleteServersTestJSON-285930608 tempest-DeleteServersTestJSON-285930608-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:05:43.215736 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-bcd2985f-ccf3-4274-a374-6167b8649e8b tempest-DeleteServersTestJSON-285930608 tempest-DeleteServersTestJSON-285930608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab2da92b7e94592b80ef3d7852f51ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb56c390ed7649479455d6dc3904deb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:05:43.224141 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-bcd2985f-ccf3-4274-a374-6167b8649e8b tempest-DeleteServersTestJSON-285930608 tempest-DeleteServersTestJSON-285930608-project] 10.222.0.20 "GET /compute/v2.1/servers/3858eceb-54a4-4bac-beef-8acd0afafba7" status: 200 len: 1555 microversion: 2.1 time: 0.194129 Jul 01 04:05:43.225190 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 72/152] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:05:43 2022] GET /compute/v2.1/servers/3858eceb-54a4-4bac-beef-8acd0afafba7 => generated 1555 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:05:43.959005 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-06bf274a-c078-4da9-8c6a-bf406c1360fe tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:05:43.960035 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-06bf274a-c078-4da9-8c6a-bf406c1360fe tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] [instance: f0c5fb50-4991-45b2-803d-7bcfe51f7c34] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:05:43.966452 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-06bf274a-c078-4da9-8c6a-bf406c1360fe tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:05:43.967049 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-06bf274a-c078-4da9-8c6a-bf406c1360fe tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:05:43.968030 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-06bf274a-c078-4da9-8c6a-bf406c1360fe tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:05:43.968572 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-06bf274a-c078-4da9-8c6a-bf406c1360fe tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:05:44.115011 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-06bf274a-c078-4da9-8c6a-bf406c1360fe tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8622ec5212c84d87b9b7c8f725012a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0143140d4f649478e36abcee284640c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:05:44.123994 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-06bf274a-c078-4da9-8c6a-bf406c1360fe tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] 10.222.0.20 "GET /compute/v2.1/servers/f0c5fb50-4991-45b2-803d-7bcfe51f7c34" status: 200 len: 1519 microversion: 2.1 time: 0.169694 Jul 01 04:05:44.125105 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 81/153] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:05:43 2022] GET /compute/v2.1/servers/f0c5fb50-4991-45b2-803d-7bcfe51f7c34 => generated 1519 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:05:44.258667 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-182b3da3-5729-47fa-bef3-98466f990950 tempest-DeleteServersTestJSON-285930608 tempest-DeleteServersTestJSON-285930608-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:05:44.259760 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-182b3da3-5729-47fa-bef3-98466f990950 tempest-DeleteServersTestJSON-285930608 tempest-DeleteServersTestJSON-285930608-project] [instance: 3858eceb-54a4-4bac-beef-8acd0afafba7] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:05:44.270031 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-182b3da3-5729-47fa-bef3-98466f990950 tempest-DeleteServersTestJSON-285930608 tempest-DeleteServersTestJSON-285930608-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:05:44.270644 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-182b3da3-5729-47fa-bef3-98466f990950 tempest-DeleteServersTestJSON-285930608 tempest-DeleteServersTestJSON-285930608-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:05:44.271745 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-182b3da3-5729-47fa-bef3-98466f990950 tempest-DeleteServersTestJSON-285930608 tempest-DeleteServersTestJSON-285930608-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:05:44.272404 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-182b3da3-5729-47fa-bef3-98466f990950 tempest-DeleteServersTestJSON-285930608 tempest-DeleteServersTestJSON-285930608-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:05:44.525233 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-182b3da3-5729-47fa-bef3-98466f990950 tempest-DeleteServersTestJSON-285930608 tempest-DeleteServersTestJSON-285930608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab2da92b7e94592b80ef3d7852f51ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb56c390ed7649479455d6dc3904deb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:05:44.535122 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-182b3da3-5729-47fa-bef3-98466f990950 tempest-DeleteServersTestJSON-285930608 tempest-DeleteServersTestJSON-285930608-project] 10.222.0.20 "GET /compute/v2.1/servers/3858eceb-54a4-4bac-beef-8acd0afafba7" status: 200 len: 1555 microversion: 2.1 time: 0.288054 Jul 01 04:05:44.535751 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 73/154] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:05:44 2022] GET /compute/v2.1/servers/3858eceb-54a4-4bac-beef-8acd0afafba7 => generated 1555 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:05:45.141809 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-4119224f-4b3a-47bb-9b95-bbf10520e2d7 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:05:45.143375 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-4119224f-4b3a-47bb-9b95-bbf10520e2d7 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] [instance: f0c5fb50-4991-45b2-803d-7bcfe51f7c34] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:05:45.149354 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-4119224f-4b3a-47bb-9b95-bbf10520e2d7 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:05:45.149818 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-4119224f-4b3a-47bb-9b95-bbf10520e2d7 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:05:45.150601 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-4119224f-4b3a-47bb-9b95-bbf10520e2d7 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:05:45.151046 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-4119224f-4b3a-47bb-9b95-bbf10520e2d7 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:05:45.568036 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-ffa8f4c8-c864-4e9c-b329-e2b7adcd4165 tempest-DeleteServersTestJSON-285930608 tempest-DeleteServersTestJSON-285930608-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:05:45.569198 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-ffa8f4c8-c864-4e9c-b329-e2b7adcd4165 tempest-DeleteServersTestJSON-285930608 tempest-DeleteServersTestJSON-285930608-project] [instance: 3858eceb-54a4-4bac-beef-8acd0afafba7] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:05:45.584182 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-ffa8f4c8-c864-4e9c-b329-e2b7adcd4165 tempest-DeleteServersTestJSON-285930608 tempest-DeleteServersTestJSON-285930608-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:05:45.585112 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-ffa8f4c8-c864-4e9c-b329-e2b7adcd4165 tempest-DeleteServersTestJSON-285930608 tempest-DeleteServersTestJSON-285930608-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:05:45.586619 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-ffa8f4c8-c864-4e9c-b329-e2b7adcd4165 tempest-DeleteServersTestJSON-285930608 tempest-DeleteServersTestJSON-285930608-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:05:45.587436 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-ffa8f4c8-c864-4e9c-b329-e2b7adcd4165 tempest-DeleteServersTestJSON-285930608 tempest-DeleteServersTestJSON-285930608-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:05:45.794573 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-4119224f-4b3a-47bb-9b95-bbf10520e2d7 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8622ec5212c84d87b9b7c8f725012a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0143140d4f649478e36abcee284640c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:05:45.801631 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG dbcounter [-] [118712] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:05:45.801723 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-ffa8f4c8-c864-4e9c-b329-e2b7adcd4165 tempest-DeleteServersTestJSON-285930608 tempest-DeleteServersTestJSON-285930608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab2da92b7e94592b80ef3d7852f51ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb56c390ed7649479455d6dc3904deb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:05:45.817769 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-ffa8f4c8-c864-4e9c-b329-e2b7adcd4165 tempest-DeleteServersTestJSON-285930608 tempest-DeleteServersTestJSON-285930608-project] 10.222.0.20 "GET /compute/v2.1/servers/3858eceb-54a4-4bac-beef-8acd0afafba7" status: 200 len: 1555 microversion: 2.1 time: 0.258050 Jul 01 04:05:45.827271 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 74/155] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:05:45 2022] GET /compute/v2.1/servers/3858eceb-54a4-4bac-beef-8acd0afafba7 => generated 1555 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:05:45.828028 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-4119224f-4b3a-47bb-9b95-bbf10520e2d7 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] 10.222.0.20 "GET /compute/v2.1/servers/f0c5fb50-4991-45b2-803d-7bcfe51f7c34" status: 200 len: 1519 microversion: 2.1 time: 0.682979 Jul 01 04:05:45.828028 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 82/156] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:05:45 2022] GET /compute/v2.1/servers/f0c5fb50-4991-45b2-803d-7bcfe51f7c34 => generated 1519 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:05:46.445447 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [req-cde47b4d-efaf-4001-b2cb-3f39f4bcbb09 req-448ba922-e490-4099-985f-0468b982d0d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3858eceb-54a4-4bac-beef-8acd0afafba7", "name": "network-vif-deleted", "tag": "26e078cc-b9b8-45c1-ba84-3bd54e2c9972"}]} {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 04:05:46.468661 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [req-cde47b4d-efaf-4001-b2cb-3f39f4bcbb09 req-448ba922-e490-4099-985f-0468b982d0d5 service nova] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:05:46.469294 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [req-cde47b4d-efaf-4001-b2cb-3f39f4bcbb09 req-448ba922-e490-4099-985f-0468b982d0d5 service nova] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:05:46.541460 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.compute.server_external_events [req-cde47b4d-efaf-4001-b2cb-3f39f4bcbb09 req-448ba922-e490-4099-985f-0468b982d0d5 service nova] Creating event network-vif-deleted:26e078cc-b9b8-45c1-ba84-3bd54e2c9972 for instance 3858eceb-54a4-4bac-beef-8acd0afafba7 on hv-cinder-84684 Jul 01 04:05:46.550781 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [req-cde47b4d-efaf-4001-b2cb-3f39f4bcbb09 req-448ba922-e490-4099-985f-0468b982d0d5 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112083 Jul 01 04:05:46.565093 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 75/157] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Jul 1 04:05:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 04:05:46.836963 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-ffa75cc0-1e26-44fb-a507-6f84e8eaa1e3 tempest-DeleteServersTestJSON-285930608 tempest-DeleteServersTestJSON-285930608-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:05:46.837940 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-ffa75cc0-1e26-44fb-a507-6f84e8eaa1e3 tempest-DeleteServersTestJSON-285930608 tempest-DeleteServersTestJSON-285930608-project] [instance: 3858eceb-54a4-4bac-beef-8acd0afafba7] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:05:46.843501 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-2289b5ea-a71b-40f2-9935-2398f8bab586 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:05:46.844562 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-2289b5ea-a71b-40f2-9935-2398f8bab586 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] [instance: f0c5fb50-4991-45b2-803d-7bcfe51f7c34] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:05:46.845631 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-ffa75cc0-1e26-44fb-a507-6f84e8eaa1e3 tempest-DeleteServersTestJSON-285930608 tempest-DeleteServersTestJSON-285930608-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:05:46.846135 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-ffa75cc0-1e26-44fb-a507-6f84e8eaa1e3 tempest-DeleteServersTestJSON-285930608 tempest-DeleteServersTestJSON-285930608-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:05:46.846929 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-ffa75cc0-1e26-44fb-a507-6f84e8eaa1e3 tempest-DeleteServersTestJSON-285930608 tempest-DeleteServersTestJSON-285930608-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:05:46.847416 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-ffa75cc0-1e26-44fb-a507-6f84e8eaa1e3 tempest-DeleteServersTestJSON-285930608 tempest-DeleteServersTestJSON-285930608-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:05:46.851703 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-2289b5ea-a71b-40f2-9935-2398f8bab586 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:05:46.852152 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-2289b5ea-a71b-40f2-9935-2398f8bab586 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:05:46.852925 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-2289b5ea-a71b-40f2-9935-2398f8bab586 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:05:46.853358 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-2289b5ea-a71b-40f2-9935-2398f8bab586 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:05:46.927928 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-ffa75cc0-1e26-44fb-a507-6f84e8eaa1e3 tempest-DeleteServersTestJSON-285930608 tempest-DeleteServersTestJSON-285930608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab2da92b7e94592b80ef3d7852f51ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb56c390ed7649479455d6dc3904deb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:05:46.936684 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-ffa75cc0-1e26-44fb-a507-6f84e8eaa1e3 tempest-DeleteServersTestJSON-285930608 tempest-DeleteServersTestJSON-285930608-project] 10.222.0.20 "GET /compute/v2.1/servers/3858eceb-54a4-4bac-beef-8acd0afafba7" status: 200 len: 1346 microversion: 2.1 time: 0.103756 Jul 01 04:05:46.937525 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 83/158] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:05:46 2022] GET /compute/v2.1/servers/3858eceb-54a4-4bac-beef-8acd0afafba7 => generated 1346 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:05:47.024394 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-2289b5ea-a71b-40f2-9935-2398f8bab586 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8622ec5212c84d87b9b7c8f725012a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0143140d4f649478e36abcee284640c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:05:47.037427 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-2289b5ea-a71b-40f2-9935-2398f8bab586 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] 10.222.0.20 "GET /compute/v2.1/servers/f0c5fb50-4991-45b2-803d-7bcfe51f7c34" status: 200 len: 1519 microversion: 2.1 time: 0.201642 Jul 01 04:05:47.038330 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 76/159] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:05:46 2022] GET /compute/v2.1/servers/f0c5fb50-4991-45b2-803d-7bcfe51f7c34 => generated 1519 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:05:47.956930 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-c648fd43-b895-4c7e-bae3-f35637454f69 tempest-DeleteServersTestJSON-285930608 tempest-DeleteServersTestJSON-285930608-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:05:47.958149 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-c648fd43-b895-4c7e-bae3-f35637454f69 tempest-DeleteServersTestJSON-285930608 tempest-DeleteServersTestJSON-285930608-project] [instance: 3858eceb-54a4-4bac-beef-8acd0afafba7] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:05:47.965758 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-c648fd43-b895-4c7e-bae3-f35637454f69 tempest-DeleteServersTestJSON-285930608 tempest-DeleteServersTestJSON-285930608-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:05:47.966612 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-c648fd43-b895-4c7e-bae3-f35637454f69 tempest-DeleteServersTestJSON-285930608 tempest-DeleteServersTestJSON-285930608-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:05:47.967719 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-c648fd43-b895-4c7e-bae3-f35637454f69 tempest-DeleteServersTestJSON-285930608 tempest-DeleteServersTestJSON-285930608-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:05:47.968900 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-c648fd43-b895-4c7e-bae3-f35637454f69 tempest-DeleteServersTestJSON-285930608 tempest-DeleteServersTestJSON-285930608-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:05:48.010977 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-c648fd43-b895-4c7e-bae3-f35637454f69 tempest-DeleteServersTestJSON-285930608 tempest-DeleteServersTestJSON-285930608-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:05:48.011760 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-c648fd43-b895-4c7e-bae3-f35637454f69 tempest-DeleteServersTestJSON-285930608 tempest-DeleteServersTestJSON-285930608-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:05:48.012675 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.objects.instance [None req-c648fd43-b895-4c7e-bae3-f35637454f69 tempest-DeleteServersTestJSON-285930608 tempest-DeleteServersTestJSON-285930608-project] Lazy-loading 'fault' on Instance uuid 3858eceb-54a4-4bac-beef-8acd0afafba7 {{(pid=118712) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 04:05:48.066723 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-300b0eb1-3543-46f3-80eb-9dea5ded91de tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:05:48.067481 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-300b0eb1-3543-46f3-80eb-9dea5ded91de tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] [instance: f0c5fb50-4991-45b2-803d-7bcfe51f7c34] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:05:48.081601 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-c648fd43-b895-4c7e-bae3-f35637454f69 tempest-DeleteServersTestJSON-285930608 tempest-DeleteServersTestJSON-285930608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab2da92b7e94592b80ef3d7852f51ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb56c390ed7649479455d6dc3904deb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:05:48.082488 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-300b0eb1-3543-46f3-80eb-9dea5ded91de tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:05:48.084378 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-300b0eb1-3543-46f3-80eb-9dea5ded91de tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:05:48.086990 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-300b0eb1-3543-46f3-80eb-9dea5ded91de tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:05:48.088867 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-300b0eb1-3543-46f3-80eb-9dea5ded91de tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:05:48.110298 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-c648fd43-b895-4c7e-bae3-f35637454f69 tempest-DeleteServersTestJSON-285930608 tempest-DeleteServersTestJSON-285930608-project] 10.222.0.20 "GET /compute/v2.1/servers/3858eceb-54a4-4bac-beef-8acd0afafba7" status: 200 len: 1351 microversion: 2.1 time: 0.157527 Jul 01 04:05:48.111773 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 84/160] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:05:47 2022] GET /compute/v2.1/servers/3858eceb-54a4-4bac-beef-8acd0afafba7 => generated 1351 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:05:48.422183 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-300b0eb1-3543-46f3-80eb-9dea5ded91de tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8622ec5212c84d87b9b7c8f725012a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0143140d4f649478e36abcee284640c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:05:48.455092 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-300b0eb1-3543-46f3-80eb-9dea5ded91de tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] 10.222.0.20 "GET /compute/v2.1/servers/f0c5fb50-4991-45b2-803d-7bcfe51f7c34" status: 200 len: 1519 microversion: 2.1 time: 0.391119 Jul 01 04:05:48.457494 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 77/161] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:05:48 2022] GET /compute/v2.1/servers/f0c5fb50-4991-45b2-803d-7bcfe51f7c34 => generated 1519 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:05:49.135919 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-d1d785bc-3a12-4ded-aa19-0b14c97cf660 tempest-DeleteServersTestJSON-285930608 tempest-DeleteServersTestJSON-285930608-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:05:49.136626 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-d1d785bc-3a12-4ded-aa19-0b14c97cf660 tempest-DeleteServersTestJSON-285930608 tempest-DeleteServersTestJSON-285930608-project] [instance: 3858eceb-54a4-4bac-beef-8acd0afafba7] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:05:49.143038 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-d1d785bc-3a12-4ded-aa19-0b14c97cf660 tempest-DeleteServersTestJSON-285930608 tempest-DeleteServersTestJSON-285930608-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:05:49.143519 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-d1d785bc-3a12-4ded-aa19-0b14c97cf660 tempest-DeleteServersTestJSON-285930608 tempest-DeleteServersTestJSON-285930608-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:05:49.144326 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-d1d785bc-3a12-4ded-aa19-0b14c97cf660 tempest-DeleteServersTestJSON-285930608 tempest-DeleteServersTestJSON-285930608-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:05:49.144771 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-d1d785bc-3a12-4ded-aa19-0b14c97cf660 tempest-DeleteServersTestJSON-285930608 tempest-DeleteServersTestJSON-285930608-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:05:49.159673 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.wsgi [None req-d1d785bc-3a12-4ded-aa19-0b14c97cf660 tempest-DeleteServersTestJSON-285930608 tempest-DeleteServersTestJSON-285930608-project] HTTP exception thrown: Instance 3858eceb-54a4-4bac-beef-8acd0afafba7 could not be found. Jul 01 04:05:49.164377 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-d1d785bc-3a12-4ded-aa19-0b14c97cf660 tempest-DeleteServersTestJSON-285930608 tempest-DeleteServersTestJSON-285930608-project] Request method failure captured: Jul 01 04:05:49.164377 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: request: GET /compute/v2.1/servers/3858eceb-54a4-4bac-beef-8acd0afafba7 HTTP/1.1 Jul 01 04:05:49.164377 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: Accept: application/json Jul 01 04:05:49.164377 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: Accept-Encoding: identity Jul 01 04:05:49.164377 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: Connection: close Jul 01 04:05:49.164377 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: Content-Length: 0 Jul 01 04:05:49.164377 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: Content-Type: application/json Jul 01 04:05:49.164377 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: Host: 10.222.0.20 Jul 01 04:05:49.164377 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: Openstack-System-Scope: None Jul 01 04:05:49.164377 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: User-Agent: python-urllib3/1.26.9 Jul 01 04:05:49.164377 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Auth-Token: gAAAAABivnJZQQrricOxmqSSUPHPtbAw46KGQzJzK50YUaH819ScSkfULfdVL4qfstOhasv5eDdQVg5ilOfNdp9u_iEsb2_oetKnCtXoIcUvCLAUCz7UaCEaAimMMGRfMm-2dxa-40ZXOzaElL-yFGscttSlOOZzr04oWySFXJ5k_6hKvVgBWuA Jul 01 04:05:49.164377 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Domain-Id: None Jul 01 04:05:49.164377 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Domain-Name: None Jul 01 04:05:49.164377 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Identity-Status: Confirmed Jul 01 04:05:49.164377 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Is-Admin-Project: True Jul 01 04:05:49.164377 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Project-Domain-Id: default Jul 01 04:05:49.164377 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Project-Domain-Name: Default Jul 01 04:05:49.164377 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Project-Id: cb56c390ed7649479455d6dc3904deb0 Jul 01 04:05:49.164377 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Project-Name: tempest-DeleteServersTestJSON-285930608 Jul 01 04:05:49.164377 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Role: reader,member Jul 01 04:05:49.164377 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Roles: reader,member Jul 01 04:05:49.167102 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/cb56c390ed7649479455d6dc3904deb0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_cb56c390ed7649479455d6dc3904deb0", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/cb56c390ed7649479455d6dc3904deb0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/cb56c390ed7649479455d6dc3904deb0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}] Jul 01 04:05:49.167102 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Tenant: tempest-DeleteServersTestJSON-285930608 Jul 01 04:05:49.167102 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Tenant-Id: cb56c390ed7649479455d6dc3904deb0 Jul 01 04:05:49.167102 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Tenant-Name: tempest-DeleteServersTestJSON-285930608 Jul 01 04:05:49.167102 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-User: tempest-DeleteServersTestJSON-285930608-project Jul 01 04:05:49.167102 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-User-Domain-Id: default Jul 01 04:05:49.167102 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-User-Domain-Name: Default Jul 01 04:05:49.167102 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-User-Id: 8ab2da92b7e94592b80ef3d7852f51ae Jul 01 04:05:49.167102 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-User-Name: tempest-DeleteServersTestJSON-285930608-project Jul 01 04:05:49.167102 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: method: > Jul 01 04:05:49.167102 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: exception: Instance 3858eceb-54a4-4bac-beef-8acd0afafba7 could not be found. Jul 01 04:05:49.167102 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: action_args: {'id': '3858eceb-54a4-4bac-beef-8acd0afafba7'} Jul 01 04:05:49.168631 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 04:05:49.168631 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 04:05:49.168631 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 04:05:49.168631 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 04:05:49.168631 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 04:05:49.168631 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 04:05:49.168631 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 04:05:49.168631 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 04:05:49.168631 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 04:05:49.168631 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 04:05:49.168631 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3858eceb-54a4-4bac-beef-8acd0afafba7 could not be found. Jul 01 04:05:49.168631 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi Jul 01 04:05:49.168631 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 04:05:49.168631 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi Jul 01 04:05:49.168631 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 04:05:49.168631 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 04:05:49.168631 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 04:05:49.168631 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 04:05:49.168631 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 04:05:49.168631 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 04:05:49.176245 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 04:05:49.176245 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 04:05:49.176245 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 04:05:49.176245 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 04:05:49.176245 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 04:05:49.176245 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 04:05:49.176245 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 04:05:49.176245 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3858eceb-54a4-4bac-beef-8acd0afafba7 could not be found. Jul 01 04:05:49.176245 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi Jul 01 04:05:49.176245 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 04:05:49.176245 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi Jul 01 04:05:49.176245 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 04:05:49.176245 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 04:05:49.176245 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 04:05:49.176245 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 04:05:49.176245 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 04:05:49.176245 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3858eceb-54a4-4bac-beef-8acd0afafba7 could not be found. Jul 01 04:05:49.176245 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi Jul 01 04:05:49.178825 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-d1d785bc-3a12-4ded-aa19-0b14c97cf660 tempest-DeleteServersTestJSON-285930608 tempest-DeleteServersTestJSON-285930608-project] Returning 404 to user: Instance 3858eceb-54a4-4bac-beef-8acd0afafba7 could not be found. {{(pid=118712) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 04:05:49.178825 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-d1d785bc-3a12-4ded-aa19-0b14c97cf660 tempest-DeleteServersTestJSON-285930608 tempest-DeleteServersTestJSON-285930608-project] 10.222.0.20 "GET /compute/v2.1/servers/3858eceb-54a4-4bac-beef-8acd0afafba7" status: 404 len: 111 microversion: 2.1 time: 0.034313 Jul 01 04:05:49.178825 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 85/162] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:05:49 2022] GET /compute/v2.1/servers/3858eceb-54a4-4bac-beef-8acd0afafba7 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 04:05:49.317225 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-61232f79-5f62-4782-8986-82f873a7ee45 tempest-DeleteServersTestJSON-285930608 tempest-DeleteServersTestJSON-285930608-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:05:49.318167 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-61232f79-5f62-4782-8986-82f873a7ee45 tempest-DeleteServersTestJSON-285930608 tempest-DeleteServersTestJSON-285930608-project] [instance: 3858eceb-54a4-4bac-beef-8acd0afafba7] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:05:49.325156 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-61232f79-5f62-4782-8986-82f873a7ee45 tempest-DeleteServersTestJSON-285930608 tempest-DeleteServersTestJSON-285930608-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:05:49.325599 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-61232f79-5f62-4782-8986-82f873a7ee45 tempest-DeleteServersTestJSON-285930608 tempest-DeleteServersTestJSON-285930608-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:05:49.326368 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-61232f79-5f62-4782-8986-82f873a7ee45 tempest-DeleteServersTestJSON-285930608 tempest-DeleteServersTestJSON-285930608-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:05:49.326808 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-61232f79-5f62-4782-8986-82f873a7ee45 tempest-DeleteServersTestJSON-285930608 tempest-DeleteServersTestJSON-285930608-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:05:49.341204 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.wsgi [None req-61232f79-5f62-4782-8986-82f873a7ee45 tempest-DeleteServersTestJSON-285930608 tempest-DeleteServersTestJSON-285930608-project] HTTP exception thrown: Instance 3858eceb-54a4-4bac-beef-8acd0afafba7 could not be found. Jul 01 04:05:49.345659 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-61232f79-5f62-4782-8986-82f873a7ee45 tempest-DeleteServersTestJSON-285930608 tempest-DeleteServersTestJSON-285930608-project] Request method failure captured: Jul 01 04:05:49.345659 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: request: GET /compute/v2.1/servers/3858eceb-54a4-4bac-beef-8acd0afafba7/os-volume_attachments HTTP/1.1 Jul 01 04:05:49.345659 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: Accept: application/json Jul 01 04:05:49.345659 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: Accept-Encoding: identity Jul 01 04:05:49.345659 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: Connection: close Jul 01 04:05:49.345659 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: Content-Length: 0 Jul 01 04:05:49.345659 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: Content-Type: application/json Jul 01 04:05:49.345659 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: Host: 10.222.0.20 Jul 01 04:05:49.345659 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: Openstack-System-Scope: None Jul 01 04:05:49.345659 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: User-Agent: python-urllib3/1.26.9 Jul 01 04:05:49.345659 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-Auth-Token: gAAAAABivnJZQQrricOxmqSSUPHPtbAw46KGQzJzK50YUaH819ScSkfULfdVL4qfstOhasv5eDdQVg5ilOfNdp9u_iEsb2_oetKnCtXoIcUvCLAUCz7UaCEaAimMMGRfMm-2dxa-40ZXOzaElL-yFGscttSlOOZzr04oWySFXJ5k_6hKvVgBWuA Jul 01 04:05:49.345659 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-Domain-Id: None Jul 01 04:05:49.345659 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-Domain-Name: None Jul 01 04:05:49.345659 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-Identity-Status: Confirmed Jul 01 04:05:49.345659 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-Is-Admin-Project: True Jul 01 04:05:49.345659 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-Project-Domain-Id: default Jul 01 04:05:49.345659 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-Project-Domain-Name: Default Jul 01 04:05:49.345659 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-Project-Id: cb56c390ed7649479455d6dc3904deb0 Jul 01 04:05:49.345659 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-Project-Name: tempest-DeleteServersTestJSON-285930608 Jul 01 04:05:49.345659 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-Role: reader,member Jul 01 04:05:49.345659 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-Roles: reader,member Jul 01 04:05:49.347044 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/cb56c390ed7649479455d6dc3904deb0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_cb56c390ed7649479455d6dc3904deb0", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/cb56c390ed7649479455d6dc3904deb0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/cb56c390ed7649479455d6dc3904deb0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}] Jul 01 04:05:49.347044 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-Tenant: tempest-DeleteServersTestJSON-285930608 Jul 01 04:05:49.347044 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-Tenant-Id: cb56c390ed7649479455d6dc3904deb0 Jul 01 04:05:49.347044 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-Tenant-Name: tempest-DeleteServersTestJSON-285930608 Jul 01 04:05:49.347044 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-User: tempest-DeleteServersTestJSON-285930608-project Jul 01 04:05:49.347044 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-User-Domain-Id: default Jul 01 04:05:49.347044 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-User-Domain-Name: Default Jul 01 04:05:49.347044 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-User-Id: 8ab2da92b7e94592b80ef3d7852f51ae Jul 01 04:05:49.347044 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-User-Name: tempest-DeleteServersTestJSON-285930608-project Jul 01 04:05:49.347044 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: method: > Jul 01 04:05:49.347044 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: exception: Instance 3858eceb-54a4-4bac-beef-8acd0afafba7 could not be found. Jul 01 04:05:49.347044 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: action_args: {'server_id': '3858eceb-54a4-4bac-beef-8acd0afafba7'} Jul 01 04:05:49.347872 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 04:05:49.347872 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 04:05:49.347872 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 04:05:49.347872 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 04:05:49.347872 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 04:05:49.347872 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 04:05:49.347872 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 04:05:49.347872 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 04:05:49.347872 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 04:05:49.347872 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 04:05:49.347872 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3858eceb-54a4-4bac-beef-8acd0afafba7 could not be found. Jul 01 04:05:49.347872 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi Jul 01 04:05:49.347872 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 04:05:49.347872 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi Jul 01 04:05:49.347872 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 04:05:49.347872 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 04:05:49.347872 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 04:05:49.347872 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 04:05:49.347872 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 04:05:49.347872 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 04:05:49.349135 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 04:05:49.349135 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 01 04:05:49.349135 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 01 04:05:49.349135 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 01 04:05:49.349135 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 01 04:05:49.349135 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jul 01 04:05:49.349135 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jul 01 04:05:49.349135 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 04:05:49.349135 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 04:05:49.349135 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3858eceb-54a4-4bac-beef-8acd0afafba7 could not be found. Jul 01 04:05:49.349135 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi Jul 01 04:05:49.349135 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 04:05:49.349135 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi Jul 01 04:05:49.349135 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 04:05:49.349135 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 04:05:49.349135 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 04:05:49.349135 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 04:05:49.349135 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 04:05:49.349135 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3858eceb-54a4-4bac-beef-8acd0afafba7 could not be found. Jul 01 04:05:49.349135 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi Jul 01 04:05:49.351192 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-61232f79-5f62-4782-8986-82f873a7ee45 tempest-DeleteServersTestJSON-285930608 tempest-DeleteServersTestJSON-285930608-project] Returning 404 to user: Instance 3858eceb-54a4-4bac-beef-8acd0afafba7 could not be found. {{(pid=118711) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 04:05:49.352237 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-61232f79-5f62-4782-8986-82f873a7ee45 tempest-DeleteServersTestJSON-285930608 tempest-DeleteServersTestJSON-285930608-project] 10.222.0.20 "GET /compute/v2.1/servers/3858eceb-54a4-4bac-beef-8acd0afafba7/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.039139 Jul 01 04:05:49.352822 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 78/163] 10.222.0.20 () {58 vars in 1301 bytes} [Fri Jul 1 04:05:49 2022] GET /compute/v2.1/servers/3858eceb-54a4-4bac-beef-8acd0afafba7/os-volume_attachments => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 01 04:05:49.487076 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-bbf8fd59-7149-4411-b3a9-3216358c3f67 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:05:49.488249 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-bbf8fd59-7149-4411-b3a9-3216358c3f67 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] [instance: f0c5fb50-4991-45b2-803d-7bcfe51f7c34] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:05:49.498516 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-bbf8fd59-7149-4411-b3a9-3216358c3f67 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:05:49.502168 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-bbf8fd59-7149-4411-b3a9-3216358c3f67 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:05:49.502168 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-bbf8fd59-7149-4411-b3a9-3216358c3f67 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:05:49.502168 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-bbf8fd59-7149-4411-b3a9-3216358c3f67 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:05:49.668159 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-bbf8fd59-7149-4411-b3a9-3216358c3f67 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8622ec5212c84d87b9b7c8f725012a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0143140d4f649478e36abcee284640c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:05:49.677911 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-bbf8fd59-7149-4411-b3a9-3216358c3f67 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] 10.222.0.20 "GET /compute/v2.1/servers/f0c5fb50-4991-45b2-803d-7bcfe51f7c34" status: 200 len: 1519 microversion: 2.1 time: 0.199092 Jul 01 04:05:49.688714 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 86/164] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:05:49 2022] GET /compute/v2.1/servers/f0c5fb50-4991-45b2-803d-7bcfe51f7c34 => generated 1519 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:05:50.695916 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-a220d0a9-2ad9-4219-83c8-9a29a5aa8612 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:05:50.696563 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-a220d0a9-2ad9-4219-83c8-9a29a5aa8612 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] [instance: f0c5fb50-4991-45b2-803d-7bcfe51f7c34] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:05:50.704065 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-a220d0a9-2ad9-4219-83c8-9a29a5aa8612 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:05:50.704488 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-a220d0a9-2ad9-4219-83c8-9a29a5aa8612 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:05:50.705274 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-a220d0a9-2ad9-4219-83c8-9a29a5aa8612 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:05:50.705711 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-a220d0a9-2ad9-4219-83c8-9a29a5aa8612 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:05:50.908394 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-4454ee9c-e070-47ca-86c2-e0c66b047ce3 tempest-DeleteServersTestJSON-285930608 tempest-DeleteServersTestJSON-285930608-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:05:50.910045 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-4454ee9c-e070-47ca-86c2-e0c66b047ce3 tempest-DeleteServersTestJSON-285930608 tempest-DeleteServersTestJSON-285930608-project] [instance: 3858eceb-54a4-4bac-beef-8acd0afafba7] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:05:50.919115 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-4454ee9c-e070-47ca-86c2-e0c66b047ce3 tempest-DeleteServersTestJSON-285930608 tempest-DeleteServersTestJSON-285930608-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:05:50.919875 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-4454ee9c-e070-47ca-86c2-e0c66b047ce3 tempest-DeleteServersTestJSON-285930608 tempest-DeleteServersTestJSON-285930608-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:05:50.920129 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-a220d0a9-2ad9-4219-83c8-9a29a5aa8612 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8622ec5212c84d87b9b7c8f725012a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0143140d4f649478e36abcee284640c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:05:50.921146 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-4454ee9c-e070-47ca-86c2-e0c66b047ce3 tempest-DeleteServersTestJSON-285930608 tempest-DeleteServersTestJSON-285930608-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:05:50.921945 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-4454ee9c-e070-47ca-86c2-e0c66b047ce3 tempest-DeleteServersTestJSON-285930608 tempest-DeleteServersTestJSON-285930608-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:05:50.934334 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-a220d0a9-2ad9-4219-83c8-9a29a5aa8612 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] 10.222.0.20 "GET /compute/v2.1/servers/f0c5fb50-4991-45b2-803d-7bcfe51f7c34" status: 200 len: 1519 microversion: 2.1 time: 0.242238 Jul 01 04:05:50.935335 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 79/165] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:05:50 2022] GET /compute/v2.1/servers/f0c5fb50-4991-45b2-803d-7bcfe51f7c34 => generated 1519 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:05:50.940246 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.wsgi [None req-4454ee9c-e070-47ca-86c2-e0c66b047ce3 tempest-DeleteServersTestJSON-285930608 tempest-DeleteServersTestJSON-285930608-project] HTTP exception thrown: Instance 3858eceb-54a4-4bac-beef-8acd0afafba7 could not be found. Jul 01 04:05:50.942691 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-4454ee9c-e070-47ca-86c2-e0c66b047ce3 tempest-DeleteServersTestJSON-285930608 tempest-DeleteServersTestJSON-285930608-project] Request method failure captured: Jul 01 04:05:50.942691 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: request: DELETE /compute/v2.1/servers/3858eceb-54a4-4bac-beef-8acd0afafba7 HTTP/1.1 Jul 01 04:05:50.942691 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: Accept: application/json Jul 01 04:05:50.942691 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: Accept-Encoding: identity Jul 01 04:05:50.942691 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: Connection: close Jul 01 04:05:50.942691 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: Content-Length: 0 Jul 01 04:05:50.942691 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: Content-Type: application/json Jul 01 04:05:50.942691 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: Host: 10.222.0.20 Jul 01 04:05:50.942691 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: Openstack-System-Scope: None Jul 01 04:05:50.942691 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: User-Agent: python-urllib3/1.26.9 Jul 01 04:05:50.942691 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Auth-Token: gAAAAABivnJZQQrricOxmqSSUPHPtbAw46KGQzJzK50YUaH819ScSkfULfdVL4qfstOhasv5eDdQVg5ilOfNdp9u_iEsb2_oetKnCtXoIcUvCLAUCz7UaCEaAimMMGRfMm-2dxa-40ZXOzaElL-yFGscttSlOOZzr04oWySFXJ5k_6hKvVgBWuA Jul 01 04:05:50.942691 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Domain-Id: None Jul 01 04:05:50.942691 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Domain-Name: None Jul 01 04:05:50.942691 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Identity-Status: Confirmed Jul 01 04:05:50.942691 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Is-Admin-Project: True Jul 01 04:05:50.942691 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Project-Domain-Id: default Jul 01 04:05:50.942691 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Project-Domain-Name: Default Jul 01 04:05:50.942691 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Project-Id: cb56c390ed7649479455d6dc3904deb0 Jul 01 04:05:50.942691 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Project-Name: tempest-DeleteServersTestJSON-285930608 Jul 01 04:05:50.942691 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Role: reader,member Jul 01 04:05:50.942691 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Roles: reader,member Jul 01 04:05:50.945692 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/cb56c390ed7649479455d6dc3904deb0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_cb56c390ed7649479455d6dc3904deb0", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/cb56c390ed7649479455d6dc3904deb0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/cb56c390ed7649479455d6dc3904deb0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}] Jul 01 04:05:50.945692 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Tenant: tempest-DeleteServersTestJSON-285930608 Jul 01 04:05:50.945692 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Tenant-Id: cb56c390ed7649479455d6dc3904deb0 Jul 01 04:05:50.945692 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Tenant-Name: tempest-DeleteServersTestJSON-285930608 Jul 01 04:05:50.945692 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-User: tempest-DeleteServersTestJSON-285930608-project Jul 01 04:05:50.945692 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-User-Domain-Id: default Jul 01 04:05:50.945692 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-User-Domain-Name: Default Jul 01 04:05:50.945692 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-User-Id: 8ab2da92b7e94592b80ef3d7852f51ae Jul 01 04:05:50.945692 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-User-Name: tempest-DeleteServersTestJSON-285930608-project Jul 01 04:05:50.945692 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: method: > Jul 01 04:05:50.945692 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: exception: Instance 3858eceb-54a4-4bac-beef-8acd0afafba7 could not be found. Jul 01 04:05:50.945692 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: action_args: {'id': '3858eceb-54a4-4bac-beef-8acd0afafba7'} Jul 01 04:05:50.946550 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 04:05:50.946550 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 04:05:50.946550 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 04:05:50.946550 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 04:05:50.946550 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 04:05:50.946550 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 04:05:50.946550 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 04:05:50.946550 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 04:05:50.946550 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 04:05:50.946550 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 04:05:50.946550 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3858eceb-54a4-4bac-beef-8acd0afafba7 could not be found. Jul 01 04:05:50.946550 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi Jul 01 04:05:50.946550 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 04:05:50.946550 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi Jul 01 04:05:50.946550 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 04:05:50.946550 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 04:05:50.946550 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 04:05:50.946550 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 04:05:50.946550 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 04:05:50.946550 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 04:05:50.948469 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 04:05:50.948469 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 01 04:05:50.948469 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 01 04:05:50.948469 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 01 04:05:50.948469 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 01 04:05:50.948469 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 04:05:50.948469 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 04:05:50.948469 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 04:05:50.948469 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 04:05:50.948469 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3858eceb-54a4-4bac-beef-8acd0afafba7 could not be found. Jul 01 04:05:50.948469 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi Jul 01 04:05:50.948469 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 04:05:50.948469 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi Jul 01 04:05:50.948469 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 04:05:50.948469 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 04:05:50.948469 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 04:05:50.948469 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 04:05:50.948469 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 04:05:50.948469 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3858eceb-54a4-4bac-beef-8acd0afafba7 could not be found. Jul 01 04:05:50.948469 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi Jul 01 04:05:50.950078 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-4454ee9c-e070-47ca-86c2-e0c66b047ce3 tempest-DeleteServersTestJSON-285930608 tempest-DeleteServersTestJSON-285930608-project] Returning 404 to user: Instance 3858eceb-54a4-4bac-beef-8acd0afafba7 could not be found. {{(pid=118712) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 04:05:50.951276 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-4454ee9c-e070-47ca-86c2-e0c66b047ce3 tempest-DeleteServersTestJSON-285930608 tempest-DeleteServersTestJSON-285930608-project] 10.222.0.20 "DELETE /compute/v2.1/servers/3858eceb-54a4-4bac-beef-8acd0afafba7" status: 404 len: 111 microversion: 2.1 time: 0.042010 Jul 01 04:05:50.956083 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 87/166] 10.222.0.20 () {58 vars in 1238 bytes} [Fri Jul 1 04:05:50 2022] DELETE /compute/v2.1/servers/3858eceb-54a4-4bac-beef-8acd0afafba7 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 01 04:05:50.962119 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-6146df82-1a37-45fc-adba-2246890bd3fc tempest-DeleteServersTestJSON-285930608 tempest-DeleteServersTestJSON-285930608-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:05:50.963141 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-6146df82-1a37-45fc-adba-2246890bd3fc tempest-DeleteServersTestJSON-285930608 tempest-DeleteServersTestJSON-285930608-project] [instance: 3858eceb-54a4-4bac-beef-8acd0afafba7] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:05:50.970765 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-6146df82-1a37-45fc-adba-2246890bd3fc tempest-DeleteServersTestJSON-285930608 tempest-DeleteServersTestJSON-285930608-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:05:50.971389 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-6146df82-1a37-45fc-adba-2246890bd3fc tempest-DeleteServersTestJSON-285930608 tempest-DeleteServersTestJSON-285930608-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:05:50.972392 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-6146df82-1a37-45fc-adba-2246890bd3fc tempest-DeleteServersTestJSON-285930608 tempest-DeleteServersTestJSON-285930608-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:05:50.973289 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-6146df82-1a37-45fc-adba-2246890bd3fc tempest-DeleteServersTestJSON-285930608 tempest-DeleteServersTestJSON-285930608-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:05:50.988419 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.wsgi [None req-6146df82-1a37-45fc-adba-2246890bd3fc tempest-DeleteServersTestJSON-285930608 tempest-DeleteServersTestJSON-285930608-project] HTTP exception thrown: Instance 3858eceb-54a4-4bac-beef-8acd0afafba7 could not be found. Jul 01 04:05:50.995843 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-6146df82-1a37-45fc-adba-2246890bd3fc tempest-DeleteServersTestJSON-285930608 tempest-DeleteServersTestJSON-285930608-project] Request method failure captured: Jul 01 04:05:50.995843 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: request: GET /compute/v2.1/servers/3858eceb-54a4-4bac-beef-8acd0afafba7 HTTP/1.1 Jul 01 04:05:50.995843 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: Accept: application/json Jul 01 04:05:50.995843 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: Accept-Encoding: identity Jul 01 04:05:50.995843 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: Connection: close Jul 01 04:05:50.995843 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: Content-Length: 0 Jul 01 04:05:50.995843 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: Content-Type: application/json Jul 01 04:05:50.995843 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: Host: 10.222.0.20 Jul 01 04:05:50.995843 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: Openstack-System-Scope: None Jul 01 04:05:50.995843 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: User-Agent: python-urllib3/1.26.9 Jul 01 04:05:50.995843 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-Auth-Token: gAAAAABivnJZQQrricOxmqSSUPHPtbAw46KGQzJzK50YUaH819ScSkfULfdVL4qfstOhasv5eDdQVg5ilOfNdp9u_iEsb2_oetKnCtXoIcUvCLAUCz7UaCEaAimMMGRfMm-2dxa-40ZXOzaElL-yFGscttSlOOZzr04oWySFXJ5k_6hKvVgBWuA Jul 01 04:05:50.995843 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-Domain-Id: None Jul 01 04:05:50.995843 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-Domain-Name: None Jul 01 04:05:50.995843 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-Identity-Status: Confirmed Jul 01 04:05:50.995843 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-Is-Admin-Project: True Jul 01 04:05:50.995843 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-Project-Domain-Id: default Jul 01 04:05:50.995843 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-Project-Domain-Name: Default Jul 01 04:05:50.995843 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-Project-Id: cb56c390ed7649479455d6dc3904deb0 Jul 01 04:05:50.995843 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-Project-Name: tempest-DeleteServersTestJSON-285930608 Jul 01 04:05:50.995843 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-Role: reader,member Jul 01 04:05:50.995843 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-Roles: reader,member Jul 01 04:05:50.997239 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/cb56c390ed7649479455d6dc3904deb0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_cb56c390ed7649479455d6dc3904deb0", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/cb56c390ed7649479455d6dc3904deb0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/cb56c390ed7649479455d6dc3904deb0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}] Jul 01 04:05:50.997239 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-Tenant: tempest-DeleteServersTestJSON-285930608 Jul 01 04:05:50.997239 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-Tenant-Id: cb56c390ed7649479455d6dc3904deb0 Jul 01 04:05:50.997239 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-Tenant-Name: tempest-DeleteServersTestJSON-285930608 Jul 01 04:05:50.997239 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-User: tempest-DeleteServersTestJSON-285930608-project Jul 01 04:05:50.997239 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-User-Domain-Id: default Jul 01 04:05:50.997239 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-User-Domain-Name: Default Jul 01 04:05:50.997239 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-User-Id: 8ab2da92b7e94592b80ef3d7852f51ae Jul 01 04:05:50.997239 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-User-Name: tempest-DeleteServersTestJSON-285930608-project Jul 01 04:05:50.997239 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: method: > Jul 01 04:05:50.997239 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: exception: Instance 3858eceb-54a4-4bac-beef-8acd0afafba7 could not be found. Jul 01 04:05:50.997239 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: action_args: {'id': '3858eceb-54a4-4bac-beef-8acd0afafba7'} Jul 01 04:05:50.998015 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 04:05:50.998015 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 04:05:50.998015 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 04:05:50.998015 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 04:05:50.998015 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 04:05:50.998015 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 04:05:50.998015 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 04:05:50.998015 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 04:05:50.998015 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 04:05:50.998015 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 04:05:50.998015 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3858eceb-54a4-4bac-beef-8acd0afafba7 could not be found. Jul 01 04:05:50.998015 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi Jul 01 04:05:50.998015 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 04:05:50.998015 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi Jul 01 04:05:50.998015 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 04:05:50.998015 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 04:05:50.998015 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 04:05:50.998015 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 04:05:50.998015 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 04:05:50.998015 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 04:05:50.999804 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 04:05:50.999804 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 04:05:50.999804 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 04:05:50.999804 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 04:05:50.999804 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 04:05:50.999804 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 04:05:50.999804 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 04:05:50.999804 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3858eceb-54a4-4bac-beef-8acd0afafba7 could not be found. Jul 01 04:05:50.999804 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi Jul 01 04:05:50.999804 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 04:05:50.999804 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi Jul 01 04:05:50.999804 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 04:05:50.999804 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 04:05:50.999804 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 04:05:50.999804 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 04:05:50.999804 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 04:05:50.999804 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3858eceb-54a4-4bac-beef-8acd0afafba7 could not be found. Jul 01 04:05:50.999804 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi Jul 01 04:05:51.001042 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-6146df82-1a37-45fc-adba-2246890bd3fc tempest-DeleteServersTestJSON-285930608 tempest-DeleteServersTestJSON-285930608-project] Returning 404 to user: Instance 3858eceb-54a4-4bac-beef-8acd0afafba7 could not be found. {{(pid=118711) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 04:05:51.001042 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-6146df82-1a37-45fc-adba-2246890bd3fc tempest-DeleteServersTestJSON-285930608 tempest-DeleteServersTestJSON-285930608-project] 10.222.0.20 "GET /compute/v2.1/servers/3858eceb-54a4-4bac-beef-8acd0afafba7" status: 404 len: 111 microversion: 2.1 time: 0.034813 Jul 01 04:05:51.001042 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 80/167] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:05:50 2022] GET /compute/v2.1/servers/3858eceb-54a4-4bac-beef-8acd0afafba7 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 04:05:51.962221 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-dc97aad0-2416-48c4-9b07-e9ab307fb70e tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:05:51.962844 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-dc97aad0-2416-48c4-9b07-e9ab307fb70e tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] [instance: f0c5fb50-4991-45b2-803d-7bcfe51f7c34] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:05:51.969693 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-dc97aad0-2416-48c4-9b07-e9ab307fb70e tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:05:51.970143 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-dc97aad0-2416-48c4-9b07-e9ab307fb70e tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:05:51.970965 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-dc97aad0-2416-48c4-9b07-e9ab307fb70e tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:05:51.971455 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-dc97aad0-2416-48c4-9b07-e9ab307fb70e tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:05:52.234775 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-dc97aad0-2416-48c4-9b07-e9ab307fb70e tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8622ec5212c84d87b9b7c8f725012a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0143140d4f649478e36abcee284640c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:05:52.247733 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-dc97aad0-2416-48c4-9b07-e9ab307fb70e tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] 10.222.0.20 "GET /compute/v2.1/servers/f0c5fb50-4991-45b2-803d-7bcfe51f7c34" status: 200 len: 1519 microversion: 2.1 time: 0.289089 Jul 01 04:05:52.253845 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 88/168] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:05:51 2022] GET /compute/v2.1/servers/f0c5fb50-4991-45b2-803d-7bcfe51f7c34 => generated 1519 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:05:53.272474 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-3d4bc8ca-0715-477c-b146-835f0c541a53 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:05:53.274542 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-3d4bc8ca-0715-477c-b146-835f0c541a53 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] [instance: f0c5fb50-4991-45b2-803d-7bcfe51f7c34] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:05:53.288639 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-3d4bc8ca-0715-477c-b146-835f0c541a53 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:05:53.289793 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-3d4bc8ca-0715-477c-b146-835f0c541a53 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:05:53.291416 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-3d4bc8ca-0715-477c-b146-835f0c541a53 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:05:53.295960 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-3d4bc8ca-0715-477c-b146-835f0c541a53 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:05:53.495055 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-3d4bc8ca-0715-477c-b146-835f0c541a53 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8622ec5212c84d87b9b7c8f725012a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0143140d4f649478e36abcee284640c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:05:53.506189 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-3d4bc8ca-0715-477c-b146-835f0c541a53 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] 10.222.0.20 "GET /compute/v2.1/servers/f0c5fb50-4991-45b2-803d-7bcfe51f7c34" status: 200 len: 1519 microversion: 2.1 time: 0.243353 Jul 01 04:05:53.507329 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 81/169] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:05:53 2022] GET /compute/v2.1/servers/f0c5fb50-4991-45b2-803d-7bcfe51f7c34 => generated 1519 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:05:54.526733 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-434451cc-e2bd-4f5a-80df-95468e75ee1b tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:05:54.527475 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-434451cc-e2bd-4f5a-80df-95468e75ee1b tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] [instance: f0c5fb50-4991-45b2-803d-7bcfe51f7c34] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:05:54.549500 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-434451cc-e2bd-4f5a-80df-95468e75ee1b tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:05:54.550073 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-434451cc-e2bd-4f5a-80df-95468e75ee1b tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:05:54.551448 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-434451cc-e2bd-4f5a-80df-95468e75ee1b tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:05:54.552246 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-434451cc-e2bd-4f5a-80df-95468e75ee1b tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:05:54.703166 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-434451cc-e2bd-4f5a-80df-95468e75ee1b tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8622ec5212c84d87b9b7c8f725012a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0143140d4f649478e36abcee284640c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:05:54.711583 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-434451cc-e2bd-4f5a-80df-95468e75ee1b tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] 10.222.0.20 "GET /compute/v2.1/servers/f0c5fb50-4991-45b2-803d-7bcfe51f7c34" status: 200 len: 1519 microversion: 2.1 time: 0.191142 Jul 01 04:05:54.712254 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 89/170] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:05:54 2022] GET /compute/v2.1/servers/f0c5fb50-4991-45b2-803d-7bcfe51f7c34 => generated 1519 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:05:55.729087 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-f130d5f1-444e-4baf-93d3-39c93ef0dced tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:05:55.729773 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-f130d5f1-444e-4baf-93d3-39c93ef0dced tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] [instance: f0c5fb50-4991-45b2-803d-7bcfe51f7c34] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:05:55.746698 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-f130d5f1-444e-4baf-93d3-39c93ef0dced tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:05:55.747172 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-f130d5f1-444e-4baf-93d3-39c93ef0dced tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:05:55.751426 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-f130d5f1-444e-4baf-93d3-39c93ef0dced tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:05:55.751890 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-f130d5f1-444e-4baf-93d3-39c93ef0dced tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:05:56.034462 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-f130d5f1-444e-4baf-93d3-39c93ef0dced tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8622ec5212c84d87b9b7c8f725012a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0143140d4f649478e36abcee284640c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:05:56.045512 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-f130d5f1-444e-4baf-93d3-39c93ef0dced tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] 10.222.0.20 "GET /compute/v2.1/servers/f0c5fb50-4991-45b2-803d-7bcfe51f7c34" status: 200 len: 1519 microversion: 2.1 time: 0.319497 Jul 01 04:05:56.046887 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 82/171] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:05:55 2022] GET /compute/v2.1/servers/f0c5fb50-4991-45b2-803d-7bcfe51f7c34 => generated 1519 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:05:57.063853 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-c3e5fdcd-ff1d-4880-8414-19266b033e1b tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:05:57.064476 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-c3e5fdcd-ff1d-4880-8414-19266b033e1b tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] [instance: f0c5fb50-4991-45b2-803d-7bcfe51f7c34] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:05:57.087199 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-c3e5fdcd-ff1d-4880-8414-19266b033e1b tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:05:57.089942 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-c3e5fdcd-ff1d-4880-8414-19266b033e1b tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:05:57.090773 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-c3e5fdcd-ff1d-4880-8414-19266b033e1b tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:05:57.093529 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-c3e5fdcd-ff1d-4880-8414-19266b033e1b tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:05:57.315084 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-c3e5fdcd-ff1d-4880-8414-19266b033e1b tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8622ec5212c84d87b9b7c8f725012a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0143140d4f649478e36abcee284640c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:05:57.323437 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-c3e5fdcd-ff1d-4880-8414-19266b033e1b tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] 10.222.0.20 "GET /compute/v2.1/servers/f0c5fb50-4991-45b2-803d-7bcfe51f7c34" status: 200 len: 1519 microversion: 2.1 time: 0.264224 Jul 01 04:05:57.324385 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 90/172] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:05:57 2022] GET /compute/v2.1/servers/f0c5fb50-4991-45b2-803d-7bcfe51f7c34 => generated 1519 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 04:05:58.353249 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-304fe1ee-28a5-4c12-ae83-a464f71d045f tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:05:58.354310 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-304fe1ee-28a5-4c12-ae83-a464f71d045f tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] [instance: f0c5fb50-4991-45b2-803d-7bcfe51f7c34] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:05:58.366851 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-304fe1ee-28a5-4c12-ae83-a464f71d045f tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:05:58.368235 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-304fe1ee-28a5-4c12-ae83-a464f71d045f tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:05:58.369145 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-304fe1ee-28a5-4c12-ae83-a464f71d045f tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:05:58.369955 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-304fe1ee-28a5-4c12-ae83-a464f71d045f tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:05:58.551519 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-304fe1ee-28a5-4c12-ae83-a464f71d045f tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8622ec5212c84d87b9b7c8f725012a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0143140d4f649478e36abcee284640c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:05:58.570061 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-304fe1ee-28a5-4c12-ae83-a464f71d045f tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] 10.222.0.20 "GET /compute/v2.1/servers/f0c5fb50-4991-45b2-803d-7bcfe51f7c34" status: 200 len: 1519 microversion: 2.1 time: 0.218166 Jul 01 04:05:58.570061 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 83/173] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:05:58 2022] GET /compute/v2.1/servers/f0c5fb50-4991-45b2-803d-7bcfe51f7c34 => generated 1519 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:05:59.588165 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-0a020d5f-4fa0-4e49-b830-1c76567ab73d tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:05:59.592089 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-0a020d5f-4fa0-4e49-b830-1c76567ab73d tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] [instance: f0c5fb50-4991-45b2-803d-7bcfe51f7c34] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:05:59.604582 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-0a020d5f-4fa0-4e49-b830-1c76567ab73d tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:05:59.605775 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-0a020d5f-4fa0-4e49-b830-1c76567ab73d tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:05:59.607843 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-0a020d5f-4fa0-4e49-b830-1c76567ab73d tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:05:59.609592 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-0a020d5f-4fa0-4e49-b830-1c76567ab73d tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:05:59.801192 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-0a020d5f-4fa0-4e49-b830-1c76567ab73d tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8622ec5212c84d87b9b7c8f725012a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0143140d4f649478e36abcee284640c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:05:59.808846 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-0a020d5f-4fa0-4e49-b830-1c76567ab73d tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] 10.222.0.20 "GET /compute/v2.1/servers/f0c5fb50-4991-45b2-803d-7bcfe51f7c34" status: 200 len: 1519 microversion: 2.1 time: 0.227777 Jul 01 04:05:59.809429 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 91/174] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:05:59 2022] GET /compute/v2.1/servers/f0c5fb50-4991-45b2-803d-7bcfe51f7c34 => generated 1519 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:06:00.829628 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-0efe55fd-100e-4628-9999-5e82d1e68cff tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:06:00.830592 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-0efe55fd-100e-4628-9999-5e82d1e68cff tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] [instance: f0c5fb50-4991-45b2-803d-7bcfe51f7c34] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:06:00.841080 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-0efe55fd-100e-4628-9999-5e82d1e68cff tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:06:00.841810 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-0efe55fd-100e-4628-9999-5e82d1e68cff tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:06:00.855792 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-0efe55fd-100e-4628-9999-5e82d1e68cff tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:06:00.855792 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-0efe55fd-100e-4628-9999-5e82d1e68cff tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:06:01.043943 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-0efe55fd-100e-4628-9999-5e82d1e68cff tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8622ec5212c84d87b9b7c8f725012a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0143140d4f649478e36abcee284640c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:06:01.053221 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-0efe55fd-100e-4628-9999-5e82d1e68cff tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] 10.222.0.20 "GET /compute/v2.1/servers/f0c5fb50-4991-45b2-803d-7bcfe51f7c34" status: 200 len: 1519 microversion: 2.1 time: 0.229900 Jul 01 04:06:01.063709 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 84/175] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:06:00 2022] GET /compute/v2.1/servers/f0c5fb50-4991-45b2-803d-7bcfe51f7c34 => generated 1519 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:06:01.797535 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-36fef68e-aceb-46b2-98a6-a6d8ce997eff tempest-VolumesNegativeTest-1967533761 tempest-VolumesNegativeTest-1967533761-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1179119292", "imageRef": "66f9f4ba-339c-4967-8857-d65299a66629", "flavorRef": "452"}} {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 04:06:01.852970 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.network.neutron [None req-36fef68e-aceb-46b2-98a6-a6d8ce997eff tempest-VolumesNegativeTest-1967533761 tempest-VolumesNegativeTest-1967533761-project] validate_networks() for None {{(pid=118712) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 01 04:06:02.073028 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-29e29d6a-f1ae-4f58-b549-6d575a1c72cb tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:06:02.074277 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-29e29d6a-f1ae-4f58-b549-6d575a1c72cb tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] [instance: f0c5fb50-4991-45b2-803d-7bcfe51f7c34] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:06:02.087614 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-29e29d6a-f1ae-4f58-b549-6d575a1c72cb tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:06:02.087614 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-29e29d6a-f1ae-4f58-b549-6d575a1c72cb tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:06:02.097756 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-29e29d6a-f1ae-4f58-b549-6d575a1c72cb tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:06:02.097756 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-29e29d6a-f1ae-4f58-b549-6d575a1c72cb tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:06:02.729852 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-29e29d6a-f1ae-4f58-b549-6d575a1c72cb tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8622ec5212c84d87b9b7c8f725012a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0143140d4f649478e36abcee284640c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:06:02.736093 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.virt.hardware [None req-36fef68e-aceb-46b2-98a6-a6d8ce997eff tempest-VolumesNegativeTest-1967533761 tempest-VolumesNegativeTest-1967533761-project] Flavor limits 0:0:0 {{(pid=118712) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 01 04:06:02.736784 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.virt.hardware [None req-36fef68e-aceb-46b2-98a6-a6d8ce997eff tempest-VolumesNegativeTest-1967533761 tempest-VolumesNegativeTest-1967533761-project] Image limits 0:0:0 {{(pid=118712) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 01 04:06:02.737464 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.virt.hardware [None req-36fef68e-aceb-46b2-98a6-a6d8ce997eff tempest-VolumesNegativeTest-1967533761 tempest-VolumesNegativeTest-1967533761-project] Flavor pref 0:0:0 {{(pid=118712) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 01 04:06:02.738079 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.virt.hardware [None req-36fef68e-aceb-46b2-98a6-a6d8ce997eff tempest-VolumesNegativeTest-1967533761 tempest-VolumesNegativeTest-1967533761-project] Image pref 0:0:0 {{(pid=118712) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 01 04:06:02.738634 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-29e29d6a-f1ae-4f58-b549-6d575a1c72cb tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] 10.222.0.20 "GET /compute/v2.1/servers/f0c5fb50-4991-45b2-803d-7bcfe51f7c34" status: 200 len: 1519 microversion: 2.1 time: 0.669914 Jul 01 04:06:02.738790 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.virt.hardware [None req-36fef68e-aceb-46b2-98a6-a6d8ce997eff tempest-VolumesNegativeTest-1967533761 tempest-VolumesNegativeTest-1967533761-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118712) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 01 04:06:02.739597 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 85/176] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:06:02 2022] GET /compute/v2.1/servers/f0c5fb50-4991-45b2-803d-7bcfe51f7c34 => generated 1519 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 04:06:02.763984 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-36fef68e-aceb-46b2-98a6-a6d8ce997eff tempest-VolumesNegativeTest-1967533761 tempest-VolumesNegativeTest-1967533761-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:06:02.765007 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-36fef68e-aceb-46b2-98a6-a6d8ce997eff tempest-VolumesNegativeTest-1967533761 tempest-VolumesNegativeTest-1967533761-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:06:02.766472 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-36fef68e-aceb-46b2-98a6-a6d8ce997eff tempest-VolumesNegativeTest-1967533761 tempest-VolumesNegativeTest-1967533761-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:06:02.767092 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-36fef68e-aceb-46b2-98a6-a6d8ce997eff tempest-VolumesNegativeTest-1967533761 tempest-VolumesNegativeTest-1967533761-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:06:02.787764 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.quota [None req-36fef68e-aceb-46b2-98a6-a6d8ce997eff tempest-VolumesNegativeTest-1967533761 tempest-VolumesNegativeTest-1967533761-project] Getting quotas for project 12c54764cae34c12b35a6939f96aad5c. Resources: {'ram', 'cores', 'instances'} {{(pid=118712) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 04:06:02.792513 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.quota [None req-36fef68e-aceb-46b2-98a6-a6d8ce997eff tempest-VolumesNegativeTest-1967533761 tempest-VolumesNegativeTest-1967533761-project] Getting quotas for user d6515163518749d3bbe6e3eeda0a4019 and project 12c54764cae34c12b35a6939f96aad5c. Resources: {'ram', 'cores', 'instances'} {{(pid=118712) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 04:06:02.806620 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-36fef68e-aceb-46b2-98a6-a6d8ce997eff tempest-VolumesNegativeTest-1967533761 tempest-VolumesNegativeTest-1967533761-project] Going to run 1 instances... {{(pid=118712) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 01 04:06:02.809755 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-36fef68e-aceb-46b2-98a6-a6d8ce997eff tempest-VolumesNegativeTest-1967533761 tempest-VolumesNegativeTest-1967533761-project] [instance: 596d6cbe-bb44-4001-ad9c-56492619071a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='66f9f4ba-339c-4967-8857-d65299a66629',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118712) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 01 04:06:03.037201 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-36fef68e-aceb-46b2-98a6-a6d8ce997eff tempest-VolumesNegativeTest-1967533761 tempest-VolumesNegativeTest-1967533761-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.245159 Jul 01 04:06:03.038383 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 92/177] 10.222.0.20 () {60 vars in 1146 bytes} [Fri Jul 1 04:06:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 1247 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 01 04:06:03.051731 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-35cb5c3a-1ecf-43b9-b8c9-dcabfea0899a tempest-VolumesNegativeTest-1967533761 tempest-VolumesNegativeTest-1967533761-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:06:03.052706 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-35cb5c3a-1ecf-43b9-b8c9-dcabfea0899a tempest-VolumesNegativeTest-1967533761 tempest-VolumesNegativeTest-1967533761-project] [instance: 596d6cbe-bb44-4001-ad9c-56492619071a] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:06:03.166348 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-35cb5c3a-1ecf-43b9-b8c9-dcabfea0899a tempest-VolumesNegativeTest-1967533761 tempest-VolumesNegativeTest-1967533761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6515163518749d3bbe6e3eeda0a4019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12c54764cae34c12b35a6939f96aad5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:06:03.174210 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-35cb5c3a-1ecf-43b9-b8c9-dcabfea0899a tempest-VolumesNegativeTest-1967533761 tempest-VolumesNegativeTest-1967533761-project] 10.222.0.20 "GET /compute/v2.1/servers/596d6cbe-bb44-4001-ad9c-56492619071a" status: 200 len: 1215 microversion: 2.1 time: 0.129647 Jul 01 04:06:03.174837 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 86/178] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:06:03 2022] GET /compute/v2.1/servers/596d6cbe-bb44-4001-ad9c-56492619071a => generated 1215 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 04:06:03.757094 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-ab775a56-fcae-4cb1-ae26-23caa454734f tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:06:03.757760 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-ab775a56-fcae-4cb1-ae26-23caa454734f tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] [instance: f0c5fb50-4991-45b2-803d-7bcfe51f7c34] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:06:03.764985 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-ab775a56-fcae-4cb1-ae26-23caa454734f tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:06:03.765439 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-ab775a56-fcae-4cb1-ae26-23caa454734f tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:06:03.766234 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-ab775a56-fcae-4cb1-ae26-23caa454734f tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:06:03.766677 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-ab775a56-fcae-4cb1-ae26-23caa454734f tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:06:03.979028 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-ab775a56-fcae-4cb1-ae26-23caa454734f tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8622ec5212c84d87b9b7c8f725012a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0143140d4f649478e36abcee284640c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:06:03.987047 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-ab775a56-fcae-4cb1-ae26-23caa454734f tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] 10.222.0.20 "GET /compute/v2.1/servers/f0c5fb50-4991-45b2-803d-7bcfe51f7c34" status: 200 len: 1519 microversion: 2.1 time: 0.234182 Jul 01 04:06:03.987642 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 93/179] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:06:03 2022] GET /compute/v2.1/servers/f0c5fb50-4991-45b2-803d-7bcfe51f7c34 => generated 1519 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:06:04.195909 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-ccc56f40-ed87-4d92-b7eb-684016237304 tempest-VolumesNegativeTest-1967533761 tempest-VolumesNegativeTest-1967533761-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:06:04.199055 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-ccc56f40-ed87-4d92-b7eb-684016237304 tempest-VolumesNegativeTest-1967533761 tempest-VolumesNegativeTest-1967533761-project] [instance: 596d6cbe-bb44-4001-ad9c-56492619071a] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:06:04.317508 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-ccc56f40-ed87-4d92-b7eb-684016237304 tempest-VolumesNegativeTest-1967533761 tempest-VolumesNegativeTest-1967533761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6515163518749d3bbe6e3eeda0a4019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12c54764cae34c12b35a6939f96aad5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:06:04.326233 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-ccc56f40-ed87-4d92-b7eb-684016237304 tempest-VolumesNegativeTest-1967533761 tempest-VolumesNegativeTest-1967533761-project] 10.222.0.20 "GET /compute/v2.1/servers/596d6cbe-bb44-4001-ad9c-56492619071a" status: 200 len: 1215 microversion: 2.1 time: 0.136760 Jul 01 04:06:04.326866 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 87/180] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:06:04 2022] GET /compute/v2.1/servers/596d6cbe-bb44-4001-ad9c-56492619071a => generated 1215 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:06:05.005047 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-ea57f7fa-b656-47c1-9b7e-6dbfaef2b85f tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:06:05.005781 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-ea57f7fa-b656-47c1-9b7e-6dbfaef2b85f tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] [instance: f0c5fb50-4991-45b2-803d-7bcfe51f7c34] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:06:05.012702 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-ea57f7fa-b656-47c1-9b7e-6dbfaef2b85f tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:06:05.013123 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-ea57f7fa-b656-47c1-9b7e-6dbfaef2b85f tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:06:05.013936 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-ea57f7fa-b656-47c1-9b7e-6dbfaef2b85f tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:06:05.014396 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-ea57f7fa-b656-47c1-9b7e-6dbfaef2b85f tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:06:05.240414 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-ea57f7fa-b656-47c1-9b7e-6dbfaef2b85f tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8622ec5212c84d87b9b7c8f725012a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0143140d4f649478e36abcee284640c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:06:05.249364 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-ea57f7fa-b656-47c1-9b7e-6dbfaef2b85f tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] 10.222.0.20 "GET /compute/v2.1/servers/f0c5fb50-4991-45b2-803d-7bcfe51f7c34" status: 200 len: 1519 microversion: 2.1 time: 0.248215 Jul 01 04:06:05.249984 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 94/181] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:06:04 2022] GET /compute/v2.1/servers/f0c5fb50-4991-45b2-803d-7bcfe51f7c34 => generated 1519 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:06:05.364803 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-242c8af0-a128-44ba-9057-bfadebb1ecb2 tempest-VolumesNegativeTest-1967533761 tempest-VolumesNegativeTest-1967533761-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:06:05.367487 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-242c8af0-a128-44ba-9057-bfadebb1ecb2 tempest-VolumesNegativeTest-1967533761 tempest-VolumesNegativeTest-1967533761-project] [instance: 596d6cbe-bb44-4001-ad9c-56492619071a] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:06:05.395762 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-242c8af0-a128-44ba-9057-bfadebb1ecb2 tempest-VolumesNegativeTest-1967533761 tempest-VolumesNegativeTest-1967533761-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:06:05.396326 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-242c8af0-a128-44ba-9057-bfadebb1ecb2 tempest-VolumesNegativeTest-1967533761 tempest-VolumesNegativeTest-1967533761-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:06:05.397161 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-242c8af0-a128-44ba-9057-bfadebb1ecb2 tempest-VolumesNegativeTest-1967533761 tempest-VolumesNegativeTest-1967533761-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:06:05.397625 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-242c8af0-a128-44ba-9057-bfadebb1ecb2 tempest-VolumesNegativeTest-1967533761 tempest-VolumesNegativeTest-1967533761-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:06:05.508996 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-242c8af0-a128-44ba-9057-bfadebb1ecb2 tempest-VolumesNegativeTest-1967533761 tempest-VolumesNegativeTest-1967533761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6515163518749d3bbe6e3eeda0a4019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12c54764cae34c12b35a6939f96aad5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:06:05.527558 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-242c8af0-a128-44ba-9057-bfadebb1ecb2 tempest-VolumesNegativeTest-1967533761 tempest-VolumesNegativeTest-1967533761-project] 10.222.0.20 "GET /compute/v2.1/servers/596d6cbe-bb44-4001-ad9c-56492619071a" status: 200 len: 1219 microversion: 2.1 time: 0.178911 Jul 01 04:06:05.540764 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 88/182] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:06:05 2022] GET /compute/v2.1/servers/596d6cbe-bb44-4001-ad9c-56492619071a => generated 1219 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:06:06.271394 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-99b8cd5b-202e-4499-99c6-478c972a68bd tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:06:06.272609 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-99b8cd5b-202e-4499-99c6-478c972a68bd tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] [instance: f0c5fb50-4991-45b2-803d-7bcfe51f7c34] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:06:06.283596 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-99b8cd5b-202e-4499-99c6-478c972a68bd tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:06:06.284407 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-99b8cd5b-202e-4499-99c6-478c972a68bd tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:06:06.285832 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-99b8cd5b-202e-4499-99c6-478c972a68bd tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:06:06.286750 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-99b8cd5b-202e-4499-99c6-478c972a68bd tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:06:06.511501 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-99b8cd5b-202e-4499-99c6-478c972a68bd tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8622ec5212c84d87b9b7c8f725012a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0143140d4f649478e36abcee284640c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:06:06.520463 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-99b8cd5b-202e-4499-99c6-478c972a68bd tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] 10.222.0.20 "GET /compute/v2.1/servers/f0c5fb50-4991-45b2-803d-7bcfe51f7c34" status: 200 len: 1499 microversion: 2.1 time: 0.257009 Jul 01 04:06:06.521344 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 95/183] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:06:06 2022] GET /compute/v2.1/servers/f0c5fb50-4991-45b2-803d-7bcfe51f7c34 => generated 1499 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:06:06.546832 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-385eb6ee-be31-4fe4-8e18-03344a3b593f tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:06:06.547652 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-385eb6ee-be31-4fe4-8e18-03344a3b593f tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] [instance: cd6bb9ca-aa57-4dc3-98bc-8e3194003673] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:06:06.554983 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-385eb6ee-be31-4fe4-8e18-03344a3b593f tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:06:06.555568 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-385eb6ee-be31-4fe4-8e18-03344a3b593f tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:06:06.556268 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-a6ed8a85-12ec-489c-9841-35d29cb2f12b tempest-VolumesNegativeTest-1967533761 tempest-VolumesNegativeTest-1967533761-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:06:06.556452 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-385eb6ee-be31-4fe4-8e18-03344a3b593f tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:06:06.556862 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-a6ed8a85-12ec-489c-9841-35d29cb2f12b tempest-VolumesNegativeTest-1967533761 tempest-VolumesNegativeTest-1967533761-project] [instance: 596d6cbe-bb44-4001-ad9c-56492619071a] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:06:06.557015 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-385eb6ee-be31-4fe4-8e18-03344a3b593f tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:06:06.564861 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-a6ed8a85-12ec-489c-9841-35d29cb2f12b tempest-VolumesNegativeTest-1967533761 tempest-VolumesNegativeTest-1967533761-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:06:06.565486 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-a6ed8a85-12ec-489c-9841-35d29cb2f12b tempest-VolumesNegativeTest-1967533761 tempest-VolumesNegativeTest-1967533761-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:06:06.566702 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-a6ed8a85-12ec-489c-9841-35d29cb2f12b tempest-VolumesNegativeTest-1967533761 tempest-VolumesNegativeTest-1967533761-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:06:06.567347 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-a6ed8a85-12ec-489c-9841-35d29cb2f12b tempest-VolumesNegativeTest-1967533761 tempest-VolumesNegativeTest-1967533761-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:06:06.678817 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-a6ed8a85-12ec-489c-9841-35d29cb2f12b tempest-VolumesNegativeTest-1967533761 tempest-VolumesNegativeTest-1967533761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6515163518749d3bbe6e3eeda0a4019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12c54764cae34c12b35a6939f96aad5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:06:06.747609 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-a6ed8a85-12ec-489c-9841-35d29cb2f12b tempest-VolumesNegativeTest-1967533761 tempest-VolumesNegativeTest-1967533761-project] 10.222.0.20 "GET /compute/v2.1/servers/596d6cbe-bb44-4001-ad9c-56492619071a" status: 200 len: 1267 microversion: 2.1 time: 0.184694 Jul 01 04:06:06.747609 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 96/184] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:06:06 2022] GET /compute/v2.1/servers/596d6cbe-bb44-4001-ad9c-56492619071a => generated 1267 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:06:06.826585 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-385eb6ee-be31-4fe4-8e18-03344a3b593f tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8622ec5212c84d87b9b7c8f725012a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0143140d4f649478e36abcee284640c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:06:06.838960 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-385eb6ee-be31-4fe4-8e18-03344a3b593f tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] 10.222.0.20 "GET /compute/v2.1/servers/cd6bb9ca-aa57-4dc3-98bc-8e3194003673" status: 200 len: 1517 microversion: 2.1 time: 0.294695 Jul 01 04:06:06.840378 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 89/185] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:06:06 2022] GET /compute/v2.1/servers/cd6bb9ca-aa57-4dc3-98bc-8e3194003673 => generated 1517 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:06:07.776495 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-d9f3d148-bc59-4ba0-8906-fef72813fd9b tempest-VolumesNegativeTest-1967533761 tempest-VolumesNegativeTest-1967533761-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:06:07.777976 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-d9f3d148-bc59-4ba0-8906-fef72813fd9b tempest-VolumesNegativeTest-1967533761 tempest-VolumesNegativeTest-1967533761-project] [instance: 596d6cbe-bb44-4001-ad9c-56492619071a] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:06:07.789453 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-d9f3d148-bc59-4ba0-8906-fef72813fd9b tempest-VolumesNegativeTest-1967533761 tempest-VolumesNegativeTest-1967533761-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:06:07.790522 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-d9f3d148-bc59-4ba0-8906-fef72813fd9b tempest-VolumesNegativeTest-1967533761 tempest-VolumesNegativeTest-1967533761-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:06:07.791909 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-d9f3d148-bc59-4ba0-8906-fef72813fd9b tempest-VolumesNegativeTest-1967533761 tempest-VolumesNegativeTest-1967533761-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:06:07.792676 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-d9f3d148-bc59-4ba0-8906-fef72813fd9b tempest-VolumesNegativeTest-1967533761 tempest-VolumesNegativeTest-1967533761-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:06:08.027802 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-d9f3d148-bc59-4ba0-8906-fef72813fd9b tempest-VolumesNegativeTest-1967533761 tempest-VolumesNegativeTest-1967533761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6515163518749d3bbe6e3eeda0a4019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12c54764cae34c12b35a6939f96aad5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:06:08.049709 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-d9f3d148-bc59-4ba0-8906-fef72813fd9b tempest-VolumesNegativeTest-1967533761 tempest-VolumesNegativeTest-1967533761-project] 10.222.0.20 "GET /compute/v2.1/servers/596d6cbe-bb44-4001-ad9c-56492619071a" status: 200 len: 1273 microversion: 2.1 time: 0.280423 Jul 01 04:06:08.062779 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 97/186] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:06:07 2022] GET /compute/v2.1/servers/596d6cbe-bb44-4001-ad9c-56492619071a => generated 1273 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:06:09.077735 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-0d00d447-3c03-4b19-8bda-3809276cbd15 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 04:06:09.079660 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-0d00d447-3c03-4b19-8bda-3809276cbd15 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] [instance: cd6bb9ca-aa57-4dc3-98bc-8e3194003673] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:06:09.080708 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-021ef75d-e739-41ea-ab66-bd39d310d083 tempest-VolumesNegativeTest-1967533761 tempest-VolumesNegativeTest-1967533761-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:06:09.082660 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-021ef75d-e739-41ea-ab66-bd39d310d083 tempest-VolumesNegativeTest-1967533761 tempest-VolumesNegativeTest-1967533761-project] [instance: 596d6cbe-bb44-4001-ad9c-56492619071a] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:06:09.090441 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-021ef75d-e739-41ea-ab66-bd39d310d083 tempest-VolumesNegativeTest-1967533761 tempest-VolumesNegativeTest-1967533761-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:06:09.091401 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-021ef75d-e739-41ea-ab66-bd39d310d083 tempest-VolumesNegativeTest-1967533761 tempest-VolumesNegativeTest-1967533761-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:06:09.093217 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-021ef75d-e739-41ea-ab66-bd39d310d083 tempest-VolumesNegativeTest-1967533761 tempest-VolumesNegativeTest-1967533761-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:06:09.093871 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-021ef75d-e739-41ea-ab66-bd39d310d083 tempest-VolumesNegativeTest-1967533761 tempest-VolumesNegativeTest-1967533761-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:06:09.110108 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-0d00d447-3c03-4b19-8bda-3809276cbd15 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:06:09.111071 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-0d00d447-3c03-4b19-8bda-3809276cbd15 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:06:09.112207 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-0d00d447-3c03-4b19-8bda-3809276cbd15 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:06:09.117104 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-0d00d447-3c03-4b19-8bda-3809276cbd15 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:06:09.169650 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.objects.instance [None req-0d00d447-3c03-4b19-8bda-3809276cbd15 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lazy-loading 'flavor' on Instance uuid cd6bb9ca-aa57-4dc3-98bc-8e3194003673 {{(pid=118711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 04:06:09.381298 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-021ef75d-e739-41ea-ab66-bd39d310d083 tempest-VolumesNegativeTest-1967533761 tempest-VolumesNegativeTest-1967533761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6515163518749d3bbe6e3eeda0a4019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12c54764cae34c12b35a6939f96aad5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:06:09.401763 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-021ef75d-e739-41ea-ab66-bd39d310d083 tempest-VolumesNegativeTest-1967533761 tempest-VolumesNegativeTest-1967533761-project] 10.222.0.20 "GET /compute/v2.1/servers/596d6cbe-bb44-4001-ad9c-56492619071a" status: 200 len: 1315 microversion: 2.1 time: 0.327202 Jul 01 04:06:09.409403 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 98/187] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:06:09 2022] GET /compute/v2.1/servers/596d6cbe-bb44-4001-ad9c-56492619071a => generated 1315 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:06:09.445978 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG dbcounter [-] [118711] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=118711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:06:09.791416 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-0d00d447-3c03-4b19-8bda-3809276cbd15 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] 10.222.0.20 "POST /compute/v2.1/servers/cd6bb9ca-aa57-4dc3-98bc-8e3194003673/action" status: 200 len: 32 microversion: 2.1 time: 0.725395 Jul 01 04:06:09.793713 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 90/188] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Jul 1 04:06:09 2022] POST /compute/v2.1/servers/cd6bb9ca-aa57-4dc3-98bc-8e3194003673/action => generated 32 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 01 04:06:09.808335 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-f7c8a1f0-cf03-4c7a-92a1-3c947660d1a0 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:06:09.813986 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-f7c8a1f0-cf03-4c7a-92a1-3c947660d1a0 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] [instance: cd6bb9ca-aa57-4dc3-98bc-8e3194003673] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:06:09.830340 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-f7c8a1f0-cf03-4c7a-92a1-3c947660d1a0 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:06:09.834101 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-f7c8a1f0-cf03-4c7a-92a1-3c947660d1a0 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:06:09.834101 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-f7c8a1f0-cf03-4c7a-92a1-3c947660d1a0 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:06:09.834101 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-f7c8a1f0-cf03-4c7a-92a1-3c947660d1a0 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:06:10.210543 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-f7c8a1f0-cf03-4c7a-92a1-3c947660d1a0 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8622ec5212c84d87b9b7c8f725012a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0143140d4f649478e36abcee284640c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:06:10.218466 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-f7c8a1f0-cf03-4c7a-92a1-3c947660d1a0 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] 10.222.0.20 "GET /compute/v2.1/servers/cd6bb9ca-aa57-4dc3-98bc-8e3194003673" status: 200 len: 1523 microversion: 2.1 time: 0.417737 Jul 01 04:06:10.228531 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 99/189] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:06:09 2022] GET /compute/v2.1/servers/cd6bb9ca-aa57-4dc3-98bc-8e3194003673 => generated 1523 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:06:10.351153 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [req-5e5494fd-b31c-45d9-8339-66a735ffdaf3 req-bced5ffe-6921-4ea1-a3ae-b5b3c3c9c432 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "596d6cbe-bb44-4001-ad9c-56492619071a", "tag": "709ac7f4-d1cb-4917-b70a-98a51afafad5"}]} {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 04:06:10.383127 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [req-5e5494fd-b31c-45d9-8339-66a735ffdaf3 req-bced5ffe-6921-4ea1-a3ae-b5b3c3c9c432 service nova] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:06:10.384691 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [req-5e5494fd-b31c-45d9-8339-66a735ffdaf3 req-bced5ffe-6921-4ea1-a3ae-b5b3c3c9c432 service nova] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:06:10.412661 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.compute.server_external_events [req-5e5494fd-b31c-45d9-8339-66a735ffdaf3 req-bced5ffe-6921-4ea1-a3ae-b5b3c3c9c432 service nova] Creating event network-changed:709ac7f4-d1cb-4917-b70a-98a51afafad5 for instance 596d6cbe-bb44-4001-ad9c-56492619071a on hv-cinder-84684 Jul 01 04:06:10.425569 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [req-5e5494fd-b31c-45d9-8339-66a735ffdaf3 req-bced5ffe-6921-4ea1-a3ae-b5b3c3c9c432 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097878 Jul 01 04:06:10.427440 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 91/190] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Jul 1 04:06:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 04:06:10.432424 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-e6bae8fc-8fba-44e7-9d69-4d06d38b67e3 tempest-VolumesNegativeTest-1967533761 tempest-VolumesNegativeTest-1967533761-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:06:10.437233 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-e6bae8fc-8fba-44e7-9d69-4d06d38b67e3 tempest-VolumesNegativeTest-1967533761 tempest-VolumesNegativeTest-1967533761-project] [instance: 596d6cbe-bb44-4001-ad9c-56492619071a] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:06:10.456319 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-e6bae8fc-8fba-44e7-9d69-4d06d38b67e3 tempest-VolumesNegativeTest-1967533761 tempest-VolumesNegativeTest-1967533761-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:06:10.460752 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-e6bae8fc-8fba-44e7-9d69-4d06d38b67e3 tempest-VolumesNegativeTest-1967533761 tempest-VolumesNegativeTest-1967533761-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:06:10.461658 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-e6bae8fc-8fba-44e7-9d69-4d06d38b67e3 tempest-VolumesNegativeTest-1967533761 tempest-VolumesNegativeTest-1967533761-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:06:10.462149 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-e6bae8fc-8fba-44e7-9d69-4d06d38b67e3 tempest-VolumesNegativeTest-1967533761 tempest-VolumesNegativeTest-1967533761-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:06:10.959835 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-e6bae8fc-8fba-44e7-9d69-4d06d38b67e3 tempest-VolumesNegativeTest-1967533761 tempest-VolumesNegativeTest-1967533761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6515163518749d3bbe6e3eeda0a4019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12c54764cae34c12b35a6939f96aad5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:06:10.970277 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-e6bae8fc-8fba-44e7-9d69-4d06d38b67e3 tempest-VolumesNegativeTest-1967533761 tempest-VolumesNegativeTest-1967533761-project] 10.222.0.20 "GET /compute/v2.1/servers/596d6cbe-bb44-4001-ad9c-56492619071a" status: 200 len: 1315 microversion: 2.1 time: 0.543077 Jul 01 04:06:10.972237 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 100/191] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:06:10 2022] GET /compute/v2.1/servers/596d6cbe-bb44-4001-ad9c-56492619071a => generated 1315 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:06:11.241529 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-c74f24c5-c01e-42ed-8e16-b309be82c33e tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:06:11.242681 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-c74f24c5-c01e-42ed-8e16-b309be82c33e tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] [instance: cd6bb9ca-aa57-4dc3-98bc-8e3194003673] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:06:11.252946 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-c74f24c5-c01e-42ed-8e16-b309be82c33e tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:06:11.253704 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-c74f24c5-c01e-42ed-8e16-b309be82c33e tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:06:11.254964 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-c74f24c5-c01e-42ed-8e16-b309be82c33e tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:06:11.256084 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-c74f24c5-c01e-42ed-8e16-b309be82c33e tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:06:11.509338 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-c74f24c5-c01e-42ed-8e16-b309be82c33e tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8622ec5212c84d87b9b7c8f725012a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0143140d4f649478e36abcee284640c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:06:11.532145 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-c74f24c5-c01e-42ed-8e16-b309be82c33e tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] 10.222.0.20 "GET /compute/v2.1/servers/cd6bb9ca-aa57-4dc3-98bc-8e3194003673" status: 200 len: 1523 microversion: 2.1 time: 0.295597 Jul 01 04:06:11.533834 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 92/192] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:06:11 2022] GET /compute/v2.1/servers/cd6bb9ca-aa57-4dc3-98bc-8e3194003673 => generated 1523 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:06:11.993392 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-8015c0f1-b494-43c8-a1a0-096ff4dcc7fd tempest-VolumesNegativeTest-1967533761 tempest-VolumesNegativeTest-1967533761-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:06:11.994233 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-8015c0f1-b494-43c8-a1a0-096ff4dcc7fd tempest-VolumesNegativeTest-1967533761 tempest-VolumesNegativeTest-1967533761-project] [instance: 596d6cbe-bb44-4001-ad9c-56492619071a] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:06:12.001629 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-8015c0f1-b494-43c8-a1a0-096ff4dcc7fd tempest-VolumesNegativeTest-1967533761 tempest-VolumesNegativeTest-1967533761-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:06:12.002141 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-8015c0f1-b494-43c8-a1a0-096ff4dcc7fd tempest-VolumesNegativeTest-1967533761 tempest-VolumesNegativeTest-1967533761-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:06:12.002962 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-8015c0f1-b494-43c8-a1a0-096ff4dcc7fd tempest-VolumesNegativeTest-1967533761 tempest-VolumesNegativeTest-1967533761-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:06:12.003570 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-8015c0f1-b494-43c8-a1a0-096ff4dcc7fd tempest-VolumesNegativeTest-1967533761 tempest-VolumesNegativeTest-1967533761-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:06:12.006663 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG dbcounter [-] [118712] Writing DB stats nova_cell1:SELECT=100 {{(pid=118712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:06:12.215112 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-8015c0f1-b494-43c8-a1a0-096ff4dcc7fd tempest-VolumesNegativeTest-1967533761 tempest-VolumesNegativeTest-1967533761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6515163518749d3bbe6e3eeda0a4019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12c54764cae34c12b35a6939f96aad5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:06:12.223850 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-8015c0f1-b494-43c8-a1a0-096ff4dcc7fd tempest-VolumesNegativeTest-1967533761 tempest-VolumesNegativeTest-1967533761-project] 10.222.0.20 "GET /compute/v2.1/servers/596d6cbe-bb44-4001-ad9c-56492619071a" status: 200 len: 1315 microversion: 2.1 time: 0.234318 Jul 01 04:06:12.233999 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 101/193] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:06:11 2022] GET /compute/v2.1/servers/596d6cbe-bb44-4001-ad9c-56492619071a => generated 1315 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:06:12.551498 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-da198ef1-07f7-4e94-8249-ebb18307bded tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:06:12.552179 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-da198ef1-07f7-4e94-8249-ebb18307bded tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] [instance: cd6bb9ca-aa57-4dc3-98bc-8e3194003673] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:06:12.554881 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG dbcounter [-] [118711] Writing DB stats nova_api:SELECT=52 {{(pid=118711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:06:12.562367 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-da198ef1-07f7-4e94-8249-ebb18307bded tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:06:12.563477 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-da198ef1-07f7-4e94-8249-ebb18307bded tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:06:12.564515 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-da198ef1-07f7-4e94-8249-ebb18307bded tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:06:12.564952 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-da198ef1-07f7-4e94-8249-ebb18307bded tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:06:12.724340 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-da198ef1-07f7-4e94-8249-ebb18307bded tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8622ec5212c84d87b9b7c8f725012a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0143140d4f649478e36abcee284640c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:06:12.745300 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-da198ef1-07f7-4e94-8249-ebb18307bded tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] 10.222.0.20 "GET /compute/v2.1/servers/cd6bb9ca-aa57-4dc3-98bc-8e3194003673" status: 200 len: 1523 microversion: 2.1 time: 0.198142 Jul 01 04:06:12.746756 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 93/194] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:06:12 2022] GET /compute/v2.1/servers/cd6bb9ca-aa57-4dc3-98bc-8e3194003673 => generated 1523 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:06:13.244902 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-d966d534-3db5-4ade-adaa-80b520ce3f1b tempest-VolumesNegativeTest-1967533761 tempest-VolumesNegativeTest-1967533761-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:06:13.246918 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-d966d534-3db5-4ade-adaa-80b520ce3f1b tempest-VolumesNegativeTest-1967533761 tempest-VolumesNegativeTest-1967533761-project] [instance: 596d6cbe-bb44-4001-ad9c-56492619071a] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:06:13.251854 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG dbcounter [-] [118712] Writing DB stats nova_cell0:SELECT=2 {{(pid=118712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:06:13.252811 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG dbcounter [-] [118712] Writing DB stats nova_cell0:SELECT=6 {{(pid=118712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:06:13.258486 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-d966d534-3db5-4ade-adaa-80b520ce3f1b tempest-VolumesNegativeTest-1967533761 tempest-VolumesNegativeTest-1967533761-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:06:13.259199 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-d966d534-3db5-4ade-adaa-80b520ce3f1b tempest-VolumesNegativeTest-1967533761 tempest-VolumesNegativeTest-1967533761-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:06:13.260436 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-d966d534-3db5-4ade-adaa-80b520ce3f1b tempest-VolumesNegativeTest-1967533761 tempest-VolumesNegativeTest-1967533761-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:06:13.261597 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-d966d534-3db5-4ade-adaa-80b520ce3f1b tempest-VolumesNegativeTest-1967533761 tempest-VolumesNegativeTest-1967533761-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:06:13.506822 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-d966d534-3db5-4ade-adaa-80b520ce3f1b tempest-VolumesNegativeTest-1967533761 tempest-VolumesNegativeTest-1967533761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6515163518749d3bbe6e3eeda0a4019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12c54764cae34c12b35a6939f96aad5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:06:13.517005 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-d966d534-3db5-4ade-adaa-80b520ce3f1b tempest-VolumesNegativeTest-1967533761 tempest-VolumesNegativeTest-1967533761-project] 10.222.0.20 "GET /compute/v2.1/servers/596d6cbe-bb44-4001-ad9c-56492619071a" status: 200 len: 1315 microversion: 2.1 time: 0.278702 Jul 01 04:06:13.517754 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 102/195] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:06:13 2022] GET /compute/v2.1/servers/596d6cbe-bb44-4001-ad9c-56492619071a => generated 1315 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 04:06:13.770400 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-a2405c2d-29b0-4648-a981-6d88914228f5 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:06:13.772517 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-a2405c2d-29b0-4648-a981-6d88914228f5 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] [instance: cd6bb9ca-aa57-4dc3-98bc-8e3194003673] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:06:13.785091 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-a2405c2d-29b0-4648-a981-6d88914228f5 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:06:13.785797 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-a2405c2d-29b0-4648-a981-6d88914228f5 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:06:13.787002 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-a2405c2d-29b0-4648-a981-6d88914228f5 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:06:13.787559 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-a2405c2d-29b0-4648-a981-6d88914228f5 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:06:13.992362 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-a2405c2d-29b0-4648-a981-6d88914228f5 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8622ec5212c84d87b9b7c8f725012a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0143140d4f649478e36abcee284640c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:06:14.001959 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-a2405c2d-29b0-4648-a981-6d88914228f5 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] 10.222.0.20 "GET /compute/v2.1/servers/cd6bb9ca-aa57-4dc3-98bc-8e3194003673" status: 200 len: 1523 microversion: 2.1 time: 0.240708 Jul 01 04:06:14.008134 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 94/196] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:06:13 2022] GET /compute/v2.1/servers/cd6bb9ca-aa57-4dc3-98bc-8e3194003673 => generated 1523 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:06:14.543437 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-44c615bf-a79d-48b5-b9ff-0c5ebf85cfa9 tempest-VolumesNegativeTest-1967533761 tempest-VolumesNegativeTest-1967533761-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:06:14.544972 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-44c615bf-a79d-48b5-b9ff-0c5ebf85cfa9 tempest-VolumesNegativeTest-1967533761 tempest-VolumesNegativeTest-1967533761-project] [instance: 596d6cbe-bb44-4001-ad9c-56492619071a] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:06:14.549105 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG dbcounter [-] [118712] Writing DB stats nova_api:SELECT=64,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=118712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:06:14.557356 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-44c615bf-a79d-48b5-b9ff-0c5ebf85cfa9 tempest-VolumesNegativeTest-1967533761 tempest-VolumesNegativeTest-1967533761-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:06:14.558598 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-44c615bf-a79d-48b5-b9ff-0c5ebf85cfa9 tempest-VolumesNegativeTest-1967533761 tempest-VolumesNegativeTest-1967533761-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:06:14.560697 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-44c615bf-a79d-48b5-b9ff-0c5ebf85cfa9 tempest-VolumesNegativeTest-1967533761 tempest-VolumesNegativeTest-1967533761-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:06:14.561493 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-44c615bf-a79d-48b5-b9ff-0c5ebf85cfa9 tempest-VolumesNegativeTest-1967533761 tempest-VolumesNegativeTest-1967533761-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:06:14.824435 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-44c615bf-a79d-48b5-b9ff-0c5ebf85cfa9 tempest-VolumesNegativeTest-1967533761 tempest-VolumesNegativeTest-1967533761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6515163518749d3bbe6e3eeda0a4019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12c54764cae34c12b35a6939f96aad5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:06:14.834796 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-44c615bf-a79d-48b5-b9ff-0c5ebf85cfa9 tempest-VolumesNegativeTest-1967533761 tempest-VolumesNegativeTest-1967533761-project] 10.222.0.20 "GET /compute/v2.1/servers/596d6cbe-bb44-4001-ad9c-56492619071a" status: 200 len: 1315 microversion: 2.1 time: 0.295975 Jul 01 04:06:14.835750 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 103/197] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:06:14 2022] GET /compute/v2.1/servers/596d6cbe-bb44-4001-ad9c-56492619071a => generated 1315 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 04:06:15.024062 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-516c28c0-8402-4fdd-865b-050c82ac96b8 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:06:15.025362 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-516c28c0-8402-4fdd-865b-050c82ac96b8 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] [instance: cd6bb9ca-aa57-4dc3-98bc-8e3194003673] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:06:15.026750 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG dbcounter [-] [118711] Writing DB stats nova_cell0:SELECT=4 {{(pid=118711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:06:15.033561 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-516c28c0-8402-4fdd-865b-050c82ac96b8 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:06:15.034027 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-516c28c0-8402-4fdd-865b-050c82ac96b8 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:06:15.034812 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-516c28c0-8402-4fdd-865b-050c82ac96b8 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:06:15.035285 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-516c28c0-8402-4fdd-865b-050c82ac96b8 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:06:15.208195 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-516c28c0-8402-4fdd-865b-050c82ac96b8 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8622ec5212c84d87b9b7c8f725012a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0143140d4f649478e36abcee284640c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:06:15.217144 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-516c28c0-8402-4fdd-865b-050c82ac96b8 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] 10.222.0.20 "GET /compute/v2.1/servers/cd6bb9ca-aa57-4dc3-98bc-8e3194003673" status: 200 len: 1523 microversion: 2.1 time: 0.196636 Jul 01 04:06:15.217748 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 95/198] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:06:15 2022] GET /compute/v2.1/servers/cd6bb9ca-aa57-4dc3-98bc-8e3194003673 => generated 1523 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:06:15.854024 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-4602dd24-3da9-450f-a95e-badbcc9199a9 tempest-VolumesNegativeTest-1967533761 tempest-VolumesNegativeTest-1967533761-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:06:15.854939 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-4602dd24-3da9-450f-a95e-badbcc9199a9 tempest-VolumesNegativeTest-1967533761 tempest-VolumesNegativeTest-1967533761-project] [instance: 596d6cbe-bb44-4001-ad9c-56492619071a] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:06:15.862237 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-4602dd24-3da9-450f-a95e-badbcc9199a9 tempest-VolumesNegativeTest-1967533761 tempest-VolumesNegativeTest-1967533761-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:06:15.862826 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-4602dd24-3da9-450f-a95e-badbcc9199a9 tempest-VolumesNegativeTest-1967533761 tempest-VolumesNegativeTest-1967533761-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:06:15.863659 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-4602dd24-3da9-450f-a95e-badbcc9199a9 tempest-VolumesNegativeTest-1967533761 tempest-VolumesNegativeTest-1967533761-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:06:15.864102 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-4602dd24-3da9-450f-a95e-badbcc9199a9 tempest-VolumesNegativeTest-1967533761 tempest-VolumesNegativeTest-1967533761-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:06:16.020602 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-4602dd24-3da9-450f-a95e-badbcc9199a9 tempest-VolumesNegativeTest-1967533761 tempest-VolumesNegativeTest-1967533761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6515163518749d3bbe6e3eeda0a4019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12c54764cae34c12b35a6939f96aad5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:06:16.028466 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-4602dd24-3da9-450f-a95e-badbcc9199a9 tempest-VolumesNegativeTest-1967533761 tempest-VolumesNegativeTest-1967533761-project] 10.222.0.20 "GET /compute/v2.1/servers/596d6cbe-bb44-4001-ad9c-56492619071a" status: 200 len: 1315 microversion: 2.1 time: 0.178919 Jul 01 04:06:16.029329 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 104/199] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:06:15 2022] GET /compute/v2.1/servers/596d6cbe-bb44-4001-ad9c-56492619071a => generated 1315 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:06:16.239771 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-901d816f-765e-4f4c-9720-cebdcd9ba413 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:06:16.240888 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-901d816f-765e-4f4c-9720-cebdcd9ba413 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] [instance: cd6bb9ca-aa57-4dc3-98bc-8e3194003673] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:06:16.251783 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-901d816f-765e-4f4c-9720-cebdcd9ba413 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:06:16.252239 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-901d816f-765e-4f4c-9720-cebdcd9ba413 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:06:16.253024 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-901d816f-765e-4f4c-9720-cebdcd9ba413 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:06:16.253495 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-901d816f-765e-4f4c-9720-cebdcd9ba413 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:06:16.390776 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-901d816f-765e-4f4c-9720-cebdcd9ba413 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8622ec5212c84d87b9b7c8f725012a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0143140d4f649478e36abcee284640c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:06:16.398529 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-901d816f-765e-4f4c-9720-cebdcd9ba413 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] 10.222.0.20 "GET /compute/v2.1/servers/cd6bb9ca-aa57-4dc3-98bc-8e3194003673" status: 200 len: 1523 microversion: 2.1 time: 0.167510 Jul 01 04:06:16.399091 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 96/200] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:06:16 2022] GET /compute/v2.1/servers/cd6bb9ca-aa57-4dc3-98bc-8e3194003673 => generated 1523 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:06:17.046434 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-aaa1f773-8d6c-4b3a-bb0a-ac1090cc30bb tempest-VolumesNegativeTest-1967533761 tempest-VolumesNegativeTest-1967533761-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:06:17.047149 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-aaa1f773-8d6c-4b3a-bb0a-ac1090cc30bb tempest-VolumesNegativeTest-1967533761 tempest-VolumesNegativeTest-1967533761-project] [instance: 596d6cbe-bb44-4001-ad9c-56492619071a] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:06:17.054237 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-aaa1f773-8d6c-4b3a-bb0a-ac1090cc30bb tempest-VolumesNegativeTest-1967533761 tempest-VolumesNegativeTest-1967533761-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:06:17.054711 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-aaa1f773-8d6c-4b3a-bb0a-ac1090cc30bb tempest-VolumesNegativeTest-1967533761 tempest-VolumesNegativeTest-1967533761-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:06:17.055629 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-aaa1f773-8d6c-4b3a-bb0a-ac1090cc30bb tempest-VolumesNegativeTest-1967533761 tempest-VolumesNegativeTest-1967533761-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:06:17.056073 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-aaa1f773-8d6c-4b3a-bb0a-ac1090cc30bb tempest-VolumesNegativeTest-1967533761 tempest-VolumesNegativeTest-1967533761-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:06:17.209189 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-aaa1f773-8d6c-4b3a-bb0a-ac1090cc30bb tempest-VolumesNegativeTest-1967533761 tempest-VolumesNegativeTest-1967533761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6515163518749d3bbe6e3eeda0a4019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12c54764cae34c12b35a6939f96aad5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:06:17.218750 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-aaa1f773-8d6c-4b3a-bb0a-ac1090cc30bb tempest-VolumesNegativeTest-1967533761 tempest-VolumesNegativeTest-1967533761-project] 10.222.0.20 "GET /compute/v2.1/servers/596d6cbe-bb44-4001-ad9c-56492619071a" status: 200 len: 1315 microversion: 2.1 time: 0.176165 Jul 01 04:06:17.219378 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 105/201] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:06:17 2022] GET /compute/v2.1/servers/596d6cbe-bb44-4001-ad9c-56492619071a => generated 1315 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:06:17.416996 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-4ffa7b17-62a5-4fac-a08b-745e6926e778 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:06:17.418108 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-4ffa7b17-62a5-4fac-a08b-745e6926e778 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] [instance: cd6bb9ca-aa57-4dc3-98bc-8e3194003673] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:06:17.426119 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-4ffa7b17-62a5-4fac-a08b-745e6926e778 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:06:17.426746 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-4ffa7b17-62a5-4fac-a08b-745e6926e778 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:06:17.427668 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-4ffa7b17-62a5-4fac-a08b-745e6926e778 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:06:17.428478 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-4ffa7b17-62a5-4fac-a08b-745e6926e778 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:06:17.619972 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-4ffa7b17-62a5-4fac-a08b-745e6926e778 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8622ec5212c84d87b9b7c8f725012a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0143140d4f649478e36abcee284640c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:06:17.628695 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-4ffa7b17-62a5-4fac-a08b-745e6926e778 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] 10.222.0.20 "GET /compute/v2.1/servers/cd6bb9ca-aa57-4dc3-98bc-8e3194003673" status: 200 len: 1523 microversion: 2.1 time: 0.216743 Jul 01 04:06:17.629276 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 97/202] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:06:17 2022] GET /compute/v2.1/servers/cd6bb9ca-aa57-4dc3-98bc-8e3194003673 => generated 1523 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 04:06:18.244033 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-fb5609d8-4e29-4965-b51a-f8da474a3cd6 tempest-VolumesNegativeTest-1967533761 tempest-VolumesNegativeTest-1967533761-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:06:18.245184 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-fb5609d8-4e29-4965-b51a-f8da474a3cd6 tempest-VolumesNegativeTest-1967533761 tempest-VolumesNegativeTest-1967533761-project] [instance: 596d6cbe-bb44-4001-ad9c-56492619071a] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:06:18.255969 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-fb5609d8-4e29-4965-b51a-f8da474a3cd6 tempest-VolumesNegativeTest-1967533761 tempest-VolumesNegativeTest-1967533761-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:06:18.256817 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-fb5609d8-4e29-4965-b51a-f8da474a3cd6 tempest-VolumesNegativeTest-1967533761 tempest-VolumesNegativeTest-1967533761-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:06:18.258189 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-fb5609d8-4e29-4965-b51a-f8da474a3cd6 tempest-VolumesNegativeTest-1967533761 tempest-VolumesNegativeTest-1967533761-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:06:18.258974 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-fb5609d8-4e29-4965-b51a-f8da474a3cd6 tempest-VolumesNegativeTest-1967533761 tempest-VolumesNegativeTest-1967533761-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:06:18.428128 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-fb5609d8-4e29-4965-b51a-f8da474a3cd6 tempest-VolumesNegativeTest-1967533761 tempest-VolumesNegativeTest-1967533761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6515163518749d3bbe6e3eeda0a4019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12c54764cae34c12b35a6939f96aad5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:06:18.448510 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-fb5609d8-4e29-4965-b51a-f8da474a3cd6 tempest-VolumesNegativeTest-1967533761 tempest-VolumesNegativeTest-1967533761-project] 10.222.0.20 "GET /compute/v2.1/servers/596d6cbe-bb44-4001-ad9c-56492619071a" status: 200 len: 1315 microversion: 2.1 time: 0.210816 Jul 01 04:06:18.449183 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 106/203] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:06:18 2022] GET /compute/v2.1/servers/596d6cbe-bb44-4001-ad9c-56492619071a => generated 1315 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:06:18.654048 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-4bb80ca2-9bc9-4808-860c-5baebf55e59d tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:06:18.656380 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-4bb80ca2-9bc9-4808-860c-5baebf55e59d tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] [instance: cd6bb9ca-aa57-4dc3-98bc-8e3194003673] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:06:18.671920 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-4bb80ca2-9bc9-4808-860c-5baebf55e59d tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:06:18.671920 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-4bb80ca2-9bc9-4808-860c-5baebf55e59d tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:06:18.672381 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-4bb80ca2-9bc9-4808-860c-5baebf55e59d tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:06:18.672774 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-4bb80ca2-9bc9-4808-860c-5baebf55e59d tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:06:18.751919 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-7e817b01-e374-4e0d-880d-997d1e8edba1 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:06:18.753046 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-7e817b01-e374-4e0d-880d-997d1e8edba1 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] [instance: b904f233-887c-4c96-a2d2-f7f415ad852f] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:06:18.763463 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-7e817b01-e374-4e0d-880d-997d1e8edba1 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:06:18.764646 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-7e817b01-e374-4e0d-880d-997d1e8edba1 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:06:18.766059 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-7e817b01-e374-4e0d-880d-997d1e8edba1 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:06:18.767061 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-7e817b01-e374-4e0d-880d-997d1e8edba1 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:06:18.821280 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-7e817b01-e374-4e0d-880d-997d1e8edba1 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] 10.222.0.20 "GET /compute/v2.1/servers/b904f233-887c-4c96-a2d2-f7f415ad852f/ips" status: 200 len: 150 microversion: 2.20 time: 0.075668 Jul 01 04:06:18.822666 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 107/204] 10.222.0.20 () {60 vars in 1288 bytes} [Fri Jul 1 04:06:18 2022] GET /compute/v2.1/servers/b904f233-887c-4c96-a2d2-f7f415ad852f/ips => generated 150 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 01 04:06:18.845799 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [req-eceb16f7-ff08-41b3-93a6-ac0172fe1937 req-d3709499-b7fc-482b-8048-16889347fcdf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "596d6cbe-bb44-4001-ad9c-56492619071a", "name": "network-vif-plugged", "status": "completed", "tag": "709ac7f4-d1cb-4917-b70a-98a51afafad5"}]} {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 04:06:18.862513 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [req-eceb16f7-ff08-41b3-93a6-ac0172fe1937 req-d3709499-b7fc-482b-8048-16889347fcdf service nova] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:06:18.863495 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [req-eceb16f7-ff08-41b3-93a6-ac0172fe1937 req-d3709499-b7fc-482b-8048-16889347fcdf service nova] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:06:18.885574 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.compute.server_external_events [req-eceb16f7-ff08-41b3-93a6-ac0172fe1937 req-d3709499-b7fc-482b-8048-16889347fcdf service nova] Creating event network-vif-plugged:709ac7f4-d1cb-4917-b70a-98a51afafad5 for instance 596d6cbe-bb44-4001-ad9c-56492619071a on hv-cinder-84684 Jul 01 04:06:18.895555 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [req-eceb16f7-ff08-41b3-93a6-ac0172fe1937 req-d3709499-b7fc-482b-8048-16889347fcdf service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061301 Jul 01 04:06:18.913437 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-4bb80ca2-9bc9-4808-860c-5baebf55e59d tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8622ec5212c84d87b9b7c8f725012a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0143140d4f649478e36abcee284640c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:06:18.917444 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 108/205] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Jul 1 04:06:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 04:06:18.928762 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-4bb80ca2-9bc9-4808-860c-5baebf55e59d tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] 10.222.0.20 "GET /compute/v2.1/servers/cd6bb9ca-aa57-4dc3-98bc-8e3194003673" status: 200 len: 1523 microversion: 2.1 time: 0.280951 Jul 01 04:06:18.930066 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 98/206] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:06:18 2022] GET /compute/v2.1/servers/cd6bb9ca-aa57-4dc3-98bc-8e3194003673 => generated 1523 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:06:19.467476 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-316b4049-9080-4fc8-8830-5e67e3b4a4e2 tempest-VolumesNegativeTest-1967533761 tempest-VolumesNegativeTest-1967533761-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:06:19.468162 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-316b4049-9080-4fc8-8830-5e67e3b4a4e2 tempest-VolumesNegativeTest-1967533761 tempest-VolumesNegativeTest-1967533761-project] [instance: 596d6cbe-bb44-4001-ad9c-56492619071a] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:06:19.474932 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-316b4049-9080-4fc8-8830-5e67e3b4a4e2 tempest-VolumesNegativeTest-1967533761 tempest-VolumesNegativeTest-1967533761-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:06:19.475738 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-316b4049-9080-4fc8-8830-5e67e3b4a4e2 tempest-VolumesNegativeTest-1967533761 tempest-VolumesNegativeTest-1967533761-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:06:19.476730 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-316b4049-9080-4fc8-8830-5e67e3b4a4e2 tempest-VolumesNegativeTest-1967533761 tempest-VolumesNegativeTest-1967533761-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:06:19.477346 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-316b4049-9080-4fc8-8830-5e67e3b4a4e2 tempest-VolumesNegativeTest-1967533761 tempest-VolumesNegativeTest-1967533761-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:06:19.670747 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-316b4049-9080-4fc8-8830-5e67e3b4a4e2 tempest-VolumesNegativeTest-1967533761 tempest-VolumesNegativeTest-1967533761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6515163518749d3bbe6e3eeda0a4019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12c54764cae34c12b35a6939f96aad5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:06:19.678801 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-316b4049-9080-4fc8-8830-5e67e3b4a4e2 tempest-VolumesNegativeTest-1967533761 tempest-VolumesNegativeTest-1967533761-project] 10.222.0.20 "GET /compute/v2.1/servers/596d6cbe-bb44-4001-ad9c-56492619071a" status: 200 len: 1315 microversion: 2.1 time: 0.216273 Jul 01 04:06:19.679445 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 109/207] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:06:19 2022] GET /compute/v2.1/servers/596d6cbe-bb44-4001-ad9c-56492619071a => generated 1315 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:06:19.953652 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-7e29c7ee-a994-42f2-9627-065485fcc84c tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:06:19.954430 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-7e29c7ee-a994-42f2-9627-065485fcc84c tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] [instance: cd6bb9ca-aa57-4dc3-98bc-8e3194003673] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:06:19.961770 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-7e29c7ee-a994-42f2-9627-065485fcc84c tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:06:19.962216 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-7e29c7ee-a994-42f2-9627-065485fcc84c tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:06:19.963094 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-7e29c7ee-a994-42f2-9627-065485fcc84c tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:06:19.963668 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-7e29c7ee-a994-42f2-9627-065485fcc84c tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:06:20.121147 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-7e29c7ee-a994-42f2-9627-065485fcc84c tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8622ec5212c84d87b9b7c8f725012a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0143140d4f649478e36abcee284640c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:06:20.129411 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-7e29c7ee-a994-42f2-9627-065485fcc84c tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] 10.222.0.20 "GET /compute/v2.1/servers/cd6bb9ca-aa57-4dc3-98bc-8e3194003673" status: 200 len: 1523 microversion: 2.1 time: 0.180300 Jul 01 04:06:20.130045 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 99/208] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:06:19 2022] GET /compute/v2.1/servers/cd6bb9ca-aa57-4dc3-98bc-8e3194003673 => generated 1523 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:06:20.701650 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-7ae07fc2-487b-49c1-a618-0c574e77f5f9 tempest-VolumesNegativeTest-1967533761 tempest-VolumesNegativeTest-1967533761-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:06:20.704474 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-7ae07fc2-487b-49c1-a618-0c574e77f5f9 tempest-VolumesNegativeTest-1967533761 tempest-VolumesNegativeTest-1967533761-project] [instance: 596d6cbe-bb44-4001-ad9c-56492619071a] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:06:20.716532 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-7ae07fc2-487b-49c1-a618-0c574e77f5f9 tempest-VolumesNegativeTest-1967533761 tempest-VolumesNegativeTest-1967533761-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:06:20.717260 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-7ae07fc2-487b-49c1-a618-0c574e77f5f9 tempest-VolumesNegativeTest-1967533761 tempest-VolumesNegativeTest-1967533761-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:06:20.719172 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-7ae07fc2-487b-49c1-a618-0c574e77f5f9 tempest-VolumesNegativeTest-1967533761 tempest-VolumesNegativeTest-1967533761-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:06:20.720153 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-7ae07fc2-487b-49c1-a618-0c574e77f5f9 tempest-VolumesNegativeTest-1967533761 tempest-VolumesNegativeTest-1967533761-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:06:20.970153 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-7ae07fc2-487b-49c1-a618-0c574e77f5f9 tempest-VolumesNegativeTest-1967533761 tempest-VolumesNegativeTest-1967533761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6515163518749d3bbe6e3eeda0a4019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12c54764cae34c12b35a6939f96aad5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:06:20.978997 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-7ae07fc2-487b-49c1-a618-0c574e77f5f9 tempest-VolumesNegativeTest-1967533761 tempest-VolumesNegativeTest-1967533761-project] 10.222.0.20 "GET /compute/v2.1/servers/596d6cbe-bb44-4001-ad9c-56492619071a" status: 200 len: 1315 microversion: 2.1 time: 0.284390 Jul 01 04:06:20.979642 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 110/209] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:06:20 2022] GET /compute/v2.1/servers/596d6cbe-bb44-4001-ad9c-56492619071a => generated 1315 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:06:21.151777 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-40e0e290-76e6-40db-ab9e-aabf31bee9b0 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:06:21.152901 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-40e0e290-76e6-40db-ab9e-aabf31bee9b0 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] [instance: cd6bb9ca-aa57-4dc3-98bc-8e3194003673] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:06:21.161824 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-40e0e290-76e6-40db-ab9e-aabf31bee9b0 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:06:21.162762 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-40e0e290-76e6-40db-ab9e-aabf31bee9b0 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:06:21.163729 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-40e0e290-76e6-40db-ab9e-aabf31bee9b0 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:06:21.164168 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-40e0e290-76e6-40db-ab9e-aabf31bee9b0 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:06:21.332681 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-40e0e290-76e6-40db-ab9e-aabf31bee9b0 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8622ec5212c84d87b9b7c8f725012a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0143140d4f649478e36abcee284640c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:06:21.344302 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-40e0e290-76e6-40db-ab9e-aabf31bee9b0 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] 10.222.0.20 "GET /compute/v2.1/servers/cd6bb9ca-aa57-4dc3-98bc-8e3194003673" status: 200 len: 1523 microversion: 2.1 time: 0.200119 Jul 01 04:06:21.345204 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 100/210] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:06:21 2022] GET /compute/v2.1/servers/cd6bb9ca-aa57-4dc3-98bc-8e3194003673 => generated 1523 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:06:22.008345 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-8dedcadc-498b-47c3-934b-1ea344e8c20d tempest-VolumesNegativeTest-1967533761 tempest-VolumesNegativeTest-1967533761-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:06:22.009506 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-8dedcadc-498b-47c3-934b-1ea344e8c20d tempest-VolumesNegativeTest-1967533761 tempest-VolumesNegativeTest-1967533761-project] [instance: 596d6cbe-bb44-4001-ad9c-56492619071a] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:06:22.020387 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-8dedcadc-498b-47c3-934b-1ea344e8c20d tempest-VolumesNegativeTest-1967533761 tempest-VolumesNegativeTest-1967533761-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:06:22.021504 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-8dedcadc-498b-47c3-934b-1ea344e8c20d tempest-VolumesNegativeTest-1967533761 tempest-VolumesNegativeTest-1967533761-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:06:22.022686 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-8dedcadc-498b-47c3-934b-1ea344e8c20d tempest-VolumesNegativeTest-1967533761 tempest-VolumesNegativeTest-1967533761-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:06:22.023176 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-8dedcadc-498b-47c3-934b-1ea344e8c20d tempest-VolumesNegativeTest-1967533761 tempest-VolumesNegativeTest-1967533761-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:06:22.163554 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-8dedcadc-498b-47c3-934b-1ea344e8c20d tempest-VolumesNegativeTest-1967533761 tempest-VolumesNegativeTest-1967533761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6515163518749d3bbe6e3eeda0a4019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12c54764cae34c12b35a6939f96aad5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:06:22.181727 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-8dedcadc-498b-47c3-934b-1ea344e8c20d tempest-VolumesNegativeTest-1967533761 tempest-VolumesNegativeTest-1967533761-project] 10.222.0.20 "GET /compute/v2.1/servers/596d6cbe-bb44-4001-ad9c-56492619071a" status: 200 len: 1315 microversion: 2.1 time: 0.180098 Jul 01 04:06:22.182519 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 111/211] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:06:21 2022] GET /compute/v2.1/servers/596d6cbe-bb44-4001-ad9c-56492619071a => generated 1315 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:06:22.366857 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-1e7f6005-7c21-48e1-9d48-c6db781d52ba tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:06:22.369761 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-1e7f6005-7c21-48e1-9d48-c6db781d52ba tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] [instance: cd6bb9ca-aa57-4dc3-98bc-8e3194003673] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:06:22.382604 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-1e7f6005-7c21-48e1-9d48-c6db781d52ba tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:06:22.394802 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-1e7f6005-7c21-48e1-9d48-c6db781d52ba tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:06:22.394802 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-1e7f6005-7c21-48e1-9d48-c6db781d52ba tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:06:22.394802 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-1e7f6005-7c21-48e1-9d48-c6db781d52ba tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:06:22.604018 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-1e7f6005-7c21-48e1-9d48-c6db781d52ba tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8622ec5212c84d87b9b7c8f725012a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0143140d4f649478e36abcee284640c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:06:22.614718 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-1e7f6005-7c21-48e1-9d48-c6db781d52ba tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] 10.222.0.20 "GET /compute/v2.1/servers/cd6bb9ca-aa57-4dc3-98bc-8e3194003673" status: 200 len: 1523 microversion: 2.1 time: 0.255507 Jul 01 04:06:22.615547 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 101/212] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:06:22 2022] GET /compute/v2.1/servers/cd6bb9ca-aa57-4dc3-98bc-8e3194003673 => generated 1523 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:06:23.032303 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-532a1798-ff54-4002-b76f-1bbf19cb8197 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 04:06:23.033279 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-532a1798-ff54-4002-b76f-1bbf19cb8197 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] [instance: b904f233-887c-4c96-a2d2-f7f415ad852f] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:06:23.044803 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-532a1798-ff54-4002-b76f-1bbf19cb8197 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:06:23.045585 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-532a1798-ff54-4002-b76f-1bbf19cb8197 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:06:23.047092 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-532a1798-ff54-4002-b76f-1bbf19cb8197 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:06:23.047951 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-532a1798-ff54-4002-b76f-1bbf19cb8197 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:06:23.085436 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.objects.instance [None req-532a1798-ff54-4002-b76f-1bbf19cb8197 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lazy-loading 'flavor' on Instance uuid b904f233-887c-4c96-a2d2-f7f415ad852f {{(pid=118712) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 04:06:23.212389 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-0f8fc8b0-c655-4890-bc30-ccebaa832cbe tempest-VolumesNegativeTest-1967533761 tempest-VolumesNegativeTest-1967533761-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:06:23.213839 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-0f8fc8b0-c655-4890-bc30-ccebaa832cbe tempest-VolumesNegativeTest-1967533761 tempest-VolumesNegativeTest-1967533761-project] [instance: 596d6cbe-bb44-4001-ad9c-56492619071a] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:06:23.229193 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-0f8fc8b0-c655-4890-bc30-ccebaa832cbe tempest-VolumesNegativeTest-1967533761 tempest-VolumesNegativeTest-1967533761-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:06:23.232739 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-0f8fc8b0-c655-4890-bc30-ccebaa832cbe tempest-VolumesNegativeTest-1967533761 tempest-VolumesNegativeTest-1967533761-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:06:23.232739 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-0f8fc8b0-c655-4890-bc30-ccebaa832cbe tempest-VolumesNegativeTest-1967533761 tempest-VolumesNegativeTest-1967533761-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:06:23.232739 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-0f8fc8b0-c655-4890-bc30-ccebaa832cbe tempest-VolumesNegativeTest-1967533761 tempest-VolumesNegativeTest-1967533761-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:06:23.563665 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-0f8fc8b0-c655-4890-bc30-ccebaa832cbe tempest-VolumesNegativeTest-1967533761 tempest-VolumesNegativeTest-1967533761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6515163518749d3bbe6e3eeda0a4019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12c54764cae34c12b35a6939f96aad5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:06:23.576546 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-0f8fc8b0-c655-4890-bc30-ccebaa832cbe tempest-VolumesNegativeTest-1967533761 tempest-VolumesNegativeTest-1967533761-project] 10.222.0.20 "GET /compute/v2.1/servers/596d6cbe-bb44-4001-ad9c-56492619071a" status: 200 len: 1315 microversion: 2.1 time: 0.370321 Jul 01 04:06:23.578034 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 102/213] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:06:23 2022] GET /compute/v2.1/servers/596d6cbe-bb44-4001-ad9c-56492619071a => generated 1315 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 04:06:23.635006 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-b2fbef23-0412-4de7-8f0d-9df7a5574255 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:06:23.639167 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-b2fbef23-0412-4de7-8f0d-9df7a5574255 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] [instance: cd6bb9ca-aa57-4dc3-98bc-8e3194003673] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:06:23.647263 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-b2fbef23-0412-4de7-8f0d-9df7a5574255 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:06:23.647994 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-b2fbef23-0412-4de7-8f0d-9df7a5574255 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:06:23.648948 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-b2fbef23-0412-4de7-8f0d-9df7a5574255 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:06:23.650137 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-b2fbef23-0412-4de7-8f0d-9df7a5574255 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:06:23.842841 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-b2fbef23-0412-4de7-8f0d-9df7a5574255 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8622ec5212c84d87b9b7c8f725012a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0143140d4f649478e36abcee284640c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:06:23.853551 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-b2fbef23-0412-4de7-8f0d-9df7a5574255 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] 10.222.0.20 "GET /compute/v2.1/servers/cd6bb9ca-aa57-4dc3-98bc-8e3194003673" status: 200 len: 1523 microversion: 2.1 time: 0.223470 Jul 01 04:06:23.854151 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 103/214] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:06:23 2022] GET /compute/v2.1/servers/cd6bb9ca-aa57-4dc3-98bc-8e3194003673 => generated 1523 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:06:24.065220 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-532a1798-ff54-4002-b76f-1bbf19cb8197 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] 10.222.0.20 "POST /compute/v2.1/servers/b904f233-887c-4c96-a2d2-f7f415ad852f/action" status: 202 len: 0 microversion: 2.20 time: 1.040574 Jul 01 04:06:24.066590 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 112/215] 10.222.0.20 () {62 vars in 1318 bytes} [Fri Jul 1 04:06:23 2022] POST /compute/v2.1/servers/b904f233-887c-4c96-a2d2-f7f415ad852f/action => generated 0 bytes in 1043 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 01 04:06:24.081355 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-d10e00a3-9d77-41da-a0c8-c72a21cc50d3 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:06:24.082477 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-d10e00a3-9d77-41da-a0c8-c72a21cc50d3 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] [instance: b904f233-887c-4c96-a2d2-f7f415ad852f] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:06:24.089805 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-d10e00a3-9d77-41da-a0c8-c72a21cc50d3 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:06:24.090261 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-d10e00a3-9d77-41da-a0c8-c72a21cc50d3 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:06:24.091092 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-d10e00a3-9d77-41da-a0c8-c72a21cc50d3 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:06:24.091603 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-d10e00a3-9d77-41da-a0c8-c72a21cc50d3 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:06:24.303912 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-d10e00a3-9d77-41da-a0c8-c72a21cc50d3 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:06:24.321570 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-d10e00a3-9d77-41da-a0c8-c72a21cc50d3 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:06:24.325737 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-d10e00a3-9d77-41da-a0c8-c72a21cc50d3 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:06:24.329002 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-d10e00a3-9d77-41da-a0c8-c72a21cc50d3 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] 10.222.0.20 "GET /compute/v2.1/servers/b904f233-887c-4c96-a2d2-f7f415ad852f" status: 200 len: 1723 microversion: 2.20 time: 0.255459 Jul 01 04:06:24.330380 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 104/216] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Jul 1 04:06:24 2022] GET /compute/v2.1/servers/b904f233-887c-4c96-a2d2-f7f415ad852f => generated 1723 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 04:06:24.609178 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-7f28ef1b-151d-44a3-ad75-70cb3c1fc78a tempest-VolumesNegativeTest-1967533761 tempest-VolumesNegativeTest-1967533761-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:06:24.610094 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-7f28ef1b-151d-44a3-ad75-70cb3c1fc78a tempest-VolumesNegativeTest-1967533761 tempest-VolumesNegativeTest-1967533761-project] [instance: 596d6cbe-bb44-4001-ad9c-56492619071a] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:06:24.618672 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-7f28ef1b-151d-44a3-ad75-70cb3c1fc78a tempest-VolumesNegativeTest-1967533761 tempest-VolumesNegativeTest-1967533761-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:06:24.619347 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-7f28ef1b-151d-44a3-ad75-70cb3c1fc78a tempest-VolumesNegativeTest-1967533761 tempest-VolumesNegativeTest-1967533761-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:06:24.620294 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-7f28ef1b-151d-44a3-ad75-70cb3c1fc78a tempest-VolumesNegativeTest-1967533761 tempest-VolumesNegativeTest-1967533761-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:06:24.620853 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-7f28ef1b-151d-44a3-ad75-70cb3c1fc78a tempest-VolumesNegativeTest-1967533761 tempest-VolumesNegativeTest-1967533761-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:06:24.880982 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-b833aed5-d6ff-4f11-a546-1e83732ef2f4 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:06:24.882111 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-b833aed5-d6ff-4f11-a546-1e83732ef2f4 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] [instance: cd6bb9ca-aa57-4dc3-98bc-8e3194003673] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:06:24.884839 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-7f28ef1b-151d-44a3-ad75-70cb3c1fc78a tempest-VolumesNegativeTest-1967533761 tempest-VolumesNegativeTest-1967533761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6515163518749d3bbe6e3eeda0a4019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12c54764cae34c12b35a6939f96aad5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:06:24.916101 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-7f28ef1b-151d-44a3-ad75-70cb3c1fc78a tempest-VolumesNegativeTest-1967533761 tempest-VolumesNegativeTest-1967533761-project] 10.222.0.20 "GET /compute/v2.1/servers/596d6cbe-bb44-4001-ad9c-56492619071a" status: 200 len: 1464 microversion: 2.1 time: 0.313316 Jul 01 04:06:24.917406 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 113/217] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:06:24 2022] GET /compute/v2.1/servers/596d6cbe-bb44-4001-ad9c-56492619071a => generated 1464 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:06:24.918596 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-b833aed5-d6ff-4f11-a546-1e83732ef2f4 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:06:24.919063 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-b833aed5-d6ff-4f11-a546-1e83732ef2f4 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:06:24.921488 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-b833aed5-d6ff-4f11-a546-1e83732ef2f4 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:06:24.923606 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-b833aed5-d6ff-4f11-a546-1e83732ef2f4 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:06:25.037555 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-7dfef053-1c81-4be2-afcb-c5fddf4d6857 tempest-VolumesNegativeTest-1967533761 tempest-VolumesNegativeTest-1967533761-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:06:25.038576 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-7dfef053-1c81-4be2-afcb-c5fddf4d6857 tempest-VolumesNegativeTest-1967533761 tempest-VolumesNegativeTest-1967533761-project] [instance: 596d6cbe-bb44-4001-ad9c-56492619071a] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:06:25.069602 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-7dfef053-1c81-4be2-afcb-c5fddf4d6857 tempest-VolumesNegativeTest-1967533761 tempest-VolumesNegativeTest-1967533761-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:06:25.069602 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-7dfef053-1c81-4be2-afcb-c5fddf4d6857 tempest-VolumesNegativeTest-1967533761 tempest-VolumesNegativeTest-1967533761-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:06:25.069602 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-7dfef053-1c81-4be2-afcb-c5fddf4d6857 tempest-VolumesNegativeTest-1967533761 tempest-VolumesNegativeTest-1967533761-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:06:25.069602 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-7dfef053-1c81-4be2-afcb-c5fddf4d6857 tempest-VolumesNegativeTest-1967533761 tempest-VolumesNegativeTest-1967533761-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:06:25.124529 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-7dfef053-1c81-4be2-afcb-c5fddf4d6857 tempest-VolumesNegativeTest-1967533761 tempest-VolumesNegativeTest-1967533761-project] [instance: 596d6cbe-bb44-4001-ad9c-56492619071a] Going to try to terminate instance {{(pid=118712) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 01 04:06:25.257581 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-b833aed5-d6ff-4f11-a546-1e83732ef2f4 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8622ec5212c84d87b9b7c8f725012a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0143140d4f649478e36abcee284640c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:06:25.267318 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-b833aed5-d6ff-4f11-a546-1e83732ef2f4 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] 10.222.0.20 "GET /compute/v2.1/servers/cd6bb9ca-aa57-4dc3-98bc-8e3194003673" status: 200 len: 1523 microversion: 2.1 time: 0.393768 Jul 01 04:06:25.268484 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 105/218] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:06:24 2022] GET /compute/v2.1/servers/cd6bb9ca-aa57-4dc3-98bc-8e3194003673 => generated 1523 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:06:25.351569 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-903fdd51-2638-4c30-85b8-03ba291265bb tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:06:25.352296 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-903fdd51-2638-4c30-85b8-03ba291265bb tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] [instance: b904f233-887c-4c96-a2d2-f7f415ad852f] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:06:25.389602 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-903fdd51-2638-4c30-85b8-03ba291265bb tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:06:25.389602 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-903fdd51-2638-4c30-85b8-03ba291265bb tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:06:25.389602 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-903fdd51-2638-4c30-85b8-03ba291265bb tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:06:25.389602 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-903fdd51-2638-4c30-85b8-03ba291265bb tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:06:25.669935 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-7dfef053-1c81-4be2-afcb-c5fddf4d6857 tempest-VolumesNegativeTest-1967533761 tempest-VolumesNegativeTest-1967533761-project] 10.222.0.20 "DELETE /compute/v2.1/servers/596d6cbe-bb44-4001-ad9c-56492619071a" status: 204 len: 0 microversion: 2.1 time: 0.637197 Jul 01 04:06:25.674628 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 114/219] 10.222.0.20 () {58 vars in 1238 bytes} [Fri Jul 1 04:06:25 2022] DELETE /compute/v2.1/servers/596d6cbe-bb44-4001-ad9c-56492619071a => generated 0 bytes in 639 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 01 04:06:25.682942 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-0d63e1a0-321e-4877-9e9f-ade0dffd34c8 tempest-VolumesNegativeTest-1967533761 tempest-VolumesNegativeTest-1967533761-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:06:25.685855 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-0d63e1a0-321e-4877-9e9f-ade0dffd34c8 tempest-VolumesNegativeTest-1967533761 tempest-VolumesNegativeTest-1967533761-project] [instance: 596d6cbe-bb44-4001-ad9c-56492619071a] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:06:25.716454 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-0d63e1a0-321e-4877-9e9f-ade0dffd34c8 tempest-VolumesNegativeTest-1967533761 tempest-VolumesNegativeTest-1967533761-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:06:25.717016 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-0d63e1a0-321e-4877-9e9f-ade0dffd34c8 tempest-VolumesNegativeTest-1967533761 tempest-VolumesNegativeTest-1967533761-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:06:25.718862 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-0d63e1a0-321e-4877-9e9f-ade0dffd34c8 tempest-VolumesNegativeTest-1967533761 tempest-VolumesNegativeTest-1967533761-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:06:25.720045 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-0d63e1a0-321e-4877-9e9f-ade0dffd34c8 tempest-VolumesNegativeTest-1967533761 tempest-VolumesNegativeTest-1967533761-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:06:25.765095 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG dbcounter [-] [118712] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=118712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:06:25.823108 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-903fdd51-2638-4c30-85b8-03ba291265bb tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:06:25.834256 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-903fdd51-2638-4c30-85b8-03ba291265bb tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:06:25.836153 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-903fdd51-2638-4c30-85b8-03ba291265bb tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:06:25.838004 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-903fdd51-2638-4c30-85b8-03ba291265bb tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] 10.222.0.20 "GET /compute/v2.1/servers/b904f233-887c-4c96-a2d2-f7f415ad852f" status: 200 len: 1723 microversion: 2.20 time: 0.491562 Jul 01 04:06:25.843990 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 106/220] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Jul 1 04:06:25 2022] GET /compute/v2.1/servers/b904f233-887c-4c96-a2d2-f7f415ad852f => generated 1723 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 01 04:06:26.000325 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-0d63e1a0-321e-4877-9e9f-ade0dffd34c8 tempest-VolumesNegativeTest-1967533761 tempest-VolumesNegativeTest-1967533761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6515163518749d3bbe6e3eeda0a4019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12c54764cae34c12b35a6939f96aad5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:06:26.016257 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-0d63e1a0-321e-4877-9e9f-ade0dffd34c8 tempest-VolumesNegativeTest-1967533761 tempest-VolumesNegativeTest-1967533761-project] 10.222.0.20 "GET /compute/v2.1/servers/596d6cbe-bb44-4001-ad9c-56492619071a" status: 200 len: 1470 microversion: 2.1 time: 0.339054 Jul 01 04:06:26.017643 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 115/221] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:06:25 2022] GET /compute/v2.1/servers/596d6cbe-bb44-4001-ad9c-56492619071a => generated 1470 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:06:26.286718 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-4ea57994-9188-46bf-a792-a460eaf642b7 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:06:26.287409 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-4ea57994-9188-46bf-a792-a460eaf642b7 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] [instance: cd6bb9ca-aa57-4dc3-98bc-8e3194003673] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:06:26.295266 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-4ea57994-9188-46bf-a792-a460eaf642b7 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:06:26.295722 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-4ea57994-9188-46bf-a792-a460eaf642b7 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:06:26.296512 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-4ea57994-9188-46bf-a792-a460eaf642b7 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:06:26.296955 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-4ea57994-9188-46bf-a792-a460eaf642b7 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:06:26.316496 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG dbcounter [-] [118711] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:06:26.860470 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-a92f28d9-b86b-48a1-ab61-a87822c72164 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:06:26.860470 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-a92f28d9-b86b-48a1-ab61-a87822c72164 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] [instance: b904f233-887c-4c96-a2d2-f7f415ad852f] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:06:26.872400 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-a92f28d9-b86b-48a1-ab61-a87822c72164 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:06:26.872891 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-a92f28d9-b86b-48a1-ab61-a87822c72164 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:06:26.878916 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-a92f28d9-b86b-48a1-ab61-a87822c72164 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:06:26.879675 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-a92f28d9-b86b-48a1-ab61-a87822c72164 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:06:27.019697 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-4ea57994-9188-46bf-a792-a460eaf642b7 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8622ec5212c84d87b9b7c8f725012a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0143140d4f649478e36abcee284640c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:06:27.073336 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-4ea57994-9188-46bf-a792-a460eaf642b7 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] 10.222.0.20 "GET /compute/v2.1/servers/cd6bb9ca-aa57-4dc3-98bc-8e3194003673" status: 200 len: 1523 microversion: 2.1 time: 0.791978 Jul 01 04:06:27.078098 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 107/222] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:06:26 2022] GET /compute/v2.1/servers/cd6bb9ca-aa57-4dc3-98bc-8e3194003673 => generated 1523 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:06:27.112781 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-ddec662e-4aa4-4453-817d-90b847edd5fa tempest-VolumesNegativeTest-1967533761 tempest-VolumesNegativeTest-1967533761-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:06:27.116033 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-ddec662e-4aa4-4453-817d-90b847edd5fa tempest-VolumesNegativeTest-1967533761 tempest-VolumesNegativeTest-1967533761-project] [instance: 596d6cbe-bb44-4001-ad9c-56492619071a] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:06:27.142511 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-ddec662e-4aa4-4453-817d-90b847edd5fa tempest-VolumesNegativeTest-1967533761 tempest-VolumesNegativeTest-1967533761-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:06:27.142989 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-ddec662e-4aa4-4453-817d-90b847edd5fa tempest-VolumesNegativeTest-1967533761 tempest-VolumesNegativeTest-1967533761-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:06:27.152452 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-ddec662e-4aa4-4453-817d-90b847edd5fa tempest-VolumesNegativeTest-1967533761 tempest-VolumesNegativeTest-1967533761-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:06:27.152923 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-ddec662e-4aa4-4453-817d-90b847edd5fa tempest-VolumesNegativeTest-1967533761 tempest-VolumesNegativeTest-1967533761-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:06:27.251214 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-a92f28d9-b86b-48a1-ab61-a87822c72164 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:06:27.261006 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-a92f28d9-b86b-48a1-ab61-a87822c72164 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:06:27.264070 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-a92f28d9-b86b-48a1-ab61-a87822c72164 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:06:27.266233 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-a92f28d9-b86b-48a1-ab61-a87822c72164 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] 10.222.0.20 "GET /compute/v2.1/servers/b904f233-887c-4c96-a2d2-f7f415ad852f" status: 200 len: 1723 microversion: 2.20 time: 0.412430 Jul 01 04:06:27.267217 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 116/223] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Jul 1 04:06:26 2022] GET /compute/v2.1/servers/b904f233-887c-4c96-a2d2-f7f415ad852f => generated 1723 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 04:06:27.622445 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-ddec662e-4aa4-4453-817d-90b847edd5fa tempest-VolumesNegativeTest-1967533761 tempest-VolumesNegativeTest-1967533761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6515163518749d3bbe6e3eeda0a4019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12c54764cae34c12b35a6939f96aad5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:06:27.636863 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-ddec662e-4aa4-4453-817d-90b847edd5fa tempest-VolumesNegativeTest-1967533761 tempest-VolumesNegativeTest-1967533761-project] 10.222.0.20 "GET /compute/v2.1/servers/596d6cbe-bb44-4001-ad9c-56492619071a" status: 200 len: 1470 microversion: 2.1 time: 0.539766 Jul 01 04:06:27.637841 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 108/224] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:06:27 2022] GET /compute/v2.1/servers/596d6cbe-bb44-4001-ad9c-56492619071a => generated 1470 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:06:28.113078 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-0a703b11-933c-44a8-b880-751713e5fb45 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:06:28.117107 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-0a703b11-933c-44a8-b880-751713e5fb45 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] [instance: cd6bb9ca-aa57-4dc3-98bc-8e3194003673] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:06:28.134240 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-0a703b11-933c-44a8-b880-751713e5fb45 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:06:28.135990 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-0a703b11-933c-44a8-b880-751713e5fb45 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:06:28.140512 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-0a703b11-933c-44a8-b880-751713e5fb45 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:06:28.155173 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-0a703b11-933c-44a8-b880-751713e5fb45 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:06:28.295268 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-1bcd6727-fc0c-4a55-8040-fffde8b28d2c tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:06:28.295905 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-1bcd6727-fc0c-4a55-8040-fffde8b28d2c tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] [instance: b904f233-887c-4c96-a2d2-f7f415ad852f] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:06:28.303555 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-1bcd6727-fc0c-4a55-8040-fffde8b28d2c tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:06:28.304280 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-1bcd6727-fc0c-4a55-8040-fffde8b28d2c tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:06:28.305282 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-1bcd6727-fc0c-4a55-8040-fffde8b28d2c tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:06:28.305883 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-1bcd6727-fc0c-4a55-8040-fffde8b28d2c tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:06:28.822445 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-1bcd6727-fc0c-4a55-8040-fffde8b28d2c tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:06:28.846837 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-1bcd6727-fc0c-4a55-8040-fffde8b28d2c tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:06:28.851667 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-1bcd6727-fc0c-4a55-8040-fffde8b28d2c tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:06:28.854286 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-1bcd6727-fc0c-4a55-8040-fffde8b28d2c tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] 10.222.0.20 "GET /compute/v2.1/servers/b904f233-887c-4c96-a2d2-f7f415ad852f" status: 200 len: 1723 microversion: 2.20 time: 0.563527 Jul 01 04:06:28.856236 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 109/225] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Jul 1 04:06:28 2022] GET /compute/v2.1/servers/b904f233-887c-4c96-a2d2-f7f415ad852f => generated 1723 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 01 04:06:28.867192 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-da59113d-2b43-4246-8c43-238ccc8267b8 tempest-VolumesNegativeTest-1967533761 tempest-VolumesNegativeTest-1967533761-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:06:28.870126 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-da59113d-2b43-4246-8c43-238ccc8267b8 tempest-VolumesNegativeTest-1967533761 tempest-VolumesNegativeTest-1967533761-project] [instance: 596d6cbe-bb44-4001-ad9c-56492619071a] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:06:28.889290 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-da59113d-2b43-4246-8c43-238ccc8267b8 tempest-VolumesNegativeTest-1967533761 tempest-VolumesNegativeTest-1967533761-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:06:28.889290 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-da59113d-2b43-4246-8c43-238ccc8267b8 tempest-VolumesNegativeTest-1967533761 tempest-VolumesNegativeTest-1967533761-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:06:28.889992 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-da59113d-2b43-4246-8c43-238ccc8267b8 tempest-VolumesNegativeTest-1967533761 tempest-VolumesNegativeTest-1967533761-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:06:28.890216 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-da59113d-2b43-4246-8c43-238ccc8267b8 tempest-VolumesNegativeTest-1967533761 tempest-VolumesNegativeTest-1967533761-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:06:28.961296 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-0a703b11-933c-44a8-b880-751713e5fb45 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8622ec5212c84d87b9b7c8f725012a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0143140d4f649478e36abcee284640c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:06:28.973024 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-0a703b11-933c-44a8-b880-751713e5fb45 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] 10.222.0.20 "GET /compute/v2.1/servers/cd6bb9ca-aa57-4dc3-98bc-8e3194003673" status: 200 len: 1523 microversion: 2.1 time: 0.876292 Jul 01 04:06:28.974226 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 117/226] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:06:28 2022] GET /compute/v2.1/servers/cd6bb9ca-aa57-4dc3-98bc-8e3194003673 => generated 1523 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:06:29.220439 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-da59113d-2b43-4246-8c43-238ccc8267b8 tempest-VolumesNegativeTest-1967533761 tempest-VolumesNegativeTest-1967533761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6515163518749d3bbe6e3eeda0a4019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12c54764cae34c12b35a6939f96aad5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:06:29.228969 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-da59113d-2b43-4246-8c43-238ccc8267b8 tempest-VolumesNegativeTest-1967533761 tempest-VolumesNegativeTest-1967533761-project] 10.222.0.20 "GET /compute/v2.1/servers/596d6cbe-bb44-4001-ad9c-56492619071a" status: 200 len: 1470 microversion: 2.1 time: 0.370522 Jul 01 04:06:29.230851 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 110/227] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:06:28 2022] GET /compute/v2.1/servers/596d6cbe-bb44-4001-ad9c-56492619071a => generated 1470 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:06:29.451542 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [req-051490a4-c973-42d6-842e-c2ef3301e66a req-93babfe8-69c1-4e08-b4d3-5f2b7fd7b76d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "596d6cbe-bb44-4001-ad9c-56492619071a", "name": "network-vif-deleted", "tag": "709ac7f4-d1cb-4917-b70a-98a51afafad5"}]} {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 04:06:29.504511 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [req-051490a4-c973-42d6-842e-c2ef3301e66a req-93babfe8-69c1-4e08-b4d3-5f2b7fd7b76d service nova] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:06:29.505311 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [req-051490a4-c973-42d6-842e-c2ef3301e66a req-93babfe8-69c1-4e08-b4d3-5f2b7fd7b76d service nova] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:06:29.532181 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.compute.server_external_events [req-051490a4-c973-42d6-842e-c2ef3301e66a req-93babfe8-69c1-4e08-b4d3-5f2b7fd7b76d service nova] Creating event network-vif-deleted:709ac7f4-d1cb-4917-b70a-98a51afafad5 for instance 596d6cbe-bb44-4001-ad9c-56492619071a on hv-cinder-84684 Jul 01 04:06:29.541941 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [req-051490a4-c973-42d6-842e-c2ef3301e66a req-93babfe8-69c1-4e08-b4d3-5f2b7fd7b76d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106252 Jul 01 04:06:29.547953 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 118/228] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Jul 1 04:06:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 01 04:06:29.929476 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-8abea060-f9a3-42be-8ef4-92ced705b8a3 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:06:29.936963 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-8abea060-f9a3-42be-8ef4-92ced705b8a3 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] [instance: b904f233-887c-4c96-a2d2-f7f415ad852f] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:06:29.974019 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-8abea060-f9a3-42be-8ef4-92ced705b8a3 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:06:29.974818 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-8abea060-f9a3-42be-8ef4-92ced705b8a3 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:06:29.976391 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-8abea060-f9a3-42be-8ef4-92ced705b8a3 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:06:29.977394 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-8abea060-f9a3-42be-8ef4-92ced705b8a3 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:06:29.991545 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-b934aa53-bb96-44f4-ad1a-1aa34ee9b5d6 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:06:29.992370 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-b934aa53-bb96-44f4-ad1a-1aa34ee9b5d6 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] [instance: cd6bb9ca-aa57-4dc3-98bc-8e3194003673] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:06:30.009439 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-b934aa53-bb96-44f4-ad1a-1aa34ee9b5d6 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:06:30.011035 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-b934aa53-bb96-44f4-ad1a-1aa34ee9b5d6 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:06:30.012255 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-b934aa53-bb96-44f4-ad1a-1aa34ee9b5d6 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:06:30.014423 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-b934aa53-bb96-44f4-ad1a-1aa34ee9b5d6 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:06:30.251095 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-8abea060-f9a3-42be-8ef4-92ced705b8a3 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:06:30.261921 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-8abea060-f9a3-42be-8ef4-92ced705b8a3 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:06:30.264546 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-8abea060-f9a3-42be-8ef4-92ced705b8a3 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:06:30.265976 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-8abea060-f9a3-42be-8ef4-92ced705b8a3 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] 10.222.0.20 "GET /compute/v2.1/servers/b904f233-887c-4c96-a2d2-f7f415ad852f" status: 200 len: 1723 microversion: 2.20 time: 0.381515 Jul 01 04:06:30.267184 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 111/229] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Jul 1 04:06:29 2022] GET /compute/v2.1/servers/b904f233-887c-4c96-a2d2-f7f415ad852f => generated 1723 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 04:06:30.272435 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-4c528cae-ff56-477d-a0ad-dee04f7e922d tempest-VolumesNegativeTest-1967533761 tempest-VolumesNegativeTest-1967533761-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:06:30.273299 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-4c528cae-ff56-477d-a0ad-dee04f7e922d tempest-VolumesNegativeTest-1967533761 tempest-VolumesNegativeTest-1967533761-project] [instance: 596d6cbe-bb44-4001-ad9c-56492619071a] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:06:30.283990 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-4c528cae-ff56-477d-a0ad-dee04f7e922d tempest-VolumesNegativeTest-1967533761 tempest-VolumesNegativeTest-1967533761-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:06:30.284753 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-4c528cae-ff56-477d-a0ad-dee04f7e922d tempest-VolumesNegativeTest-1967533761 tempest-VolumesNegativeTest-1967533761-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:06:30.285740 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-4c528cae-ff56-477d-a0ad-dee04f7e922d tempest-VolumesNegativeTest-1967533761 tempest-VolumesNegativeTest-1967533761-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:06:30.286337 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-4c528cae-ff56-477d-a0ad-dee04f7e922d tempest-VolumesNegativeTest-1967533761 tempest-VolumesNegativeTest-1967533761-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:06:30.322270 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-b934aa53-bb96-44f4-ad1a-1aa34ee9b5d6 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8622ec5212c84d87b9b7c8f725012a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0143140d4f649478e36abcee284640c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:06:30.336986 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-b934aa53-bb96-44f4-ad1a-1aa34ee9b5d6 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] 10.222.0.20 "GET /compute/v2.1/servers/cd6bb9ca-aa57-4dc3-98bc-8e3194003673" status: 200 len: 1503 microversion: 2.1 time: 0.350382 Jul 01 04:06:30.350739 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 119/230] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:06:29 2022] GET /compute/v2.1/servers/cd6bb9ca-aa57-4dc3-98bc-8e3194003673 => generated 1503 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:06:30.369651 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-0fd5b8ab-c73f-4723-b9aa-7e48c061dd0f tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5d925015-f73b-4cc2-9c93-7963d62b1d4a"}} {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 04:06:30.373569 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-0fd5b8ab-c73f-4723-b9aa-7e48c061dd0f tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] [instance: cd6bb9ca-aa57-4dc3-98bc-8e3194003673] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:06:30.382871 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-0fd5b8ab-c73f-4723-b9aa-7e48c061dd0f tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:06:30.383520 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-0fd5b8ab-c73f-4723-b9aa-7e48c061dd0f tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:06:30.393777 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-0fd5b8ab-c73f-4723-b9aa-7e48c061dd0f tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:06:30.394400 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-0fd5b8ab-c73f-4723-b9aa-7e48c061dd0f tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:06:30.448483 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.wsgi [None req-0fd5b8ab-c73f-4723-b9aa-7e48c061dd0f tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] HTTP exception thrown: Cannot 'attach_volume' instance cd6bb9ca-aa57-4dc3-98bc-8e3194003673 while it is in vm_state rescued Jul 01 04:06:30.450908 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-0fd5b8ab-c73f-4723-b9aa-7e48c061dd0f tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Request method failure captured: Jul 01 04:06:30.450908 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: request: POST /compute/v2.1/servers/cd6bb9ca-aa57-4dc3-98bc-8e3194003673/os-volume_attachments HTTP/1.1 Jul 01 04:06:30.450908 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: Accept: application/json Jul 01 04:06:30.450908 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: Accept-Encoding: identity Jul 01 04:06:30.450908 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: Connection: close Jul 01 04:06:30.450908 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: Content-Length: 74 Jul 01 04:06:30.450908 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: Content-Type: application/json Jul 01 04:06:30.450908 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: Host: 10.222.0.20 Jul 01 04:06:30.450908 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: Openstack-System-Scope: None Jul 01 04:06:30.450908 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: User-Agent: python-urllib3/1.26.9 Jul 01 04:06:30.450908 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Auth-Token: gAAAAABivnJXigIdoKNrWhyC7v2FozD51jph_FSftzrdGxe-ICt_B7b0yUdhaKt3OJM8y8lEmoukGgxdiuXdffo0lQFNFHXOWALzvqer-sv1yOLbbxqWlc2p1ew_CWt-DcVsNFKW9wSaUR95HogWWAUd-o3FI2WtqElzxvPV0N7AryVuGkczdno Jul 01 04:06:30.450908 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Domain-Id: None Jul 01 04:06:30.450908 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Domain-Name: None Jul 01 04:06:30.450908 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Identity-Status: Confirmed Jul 01 04:06:30.450908 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Is-Admin-Project: True Jul 01 04:06:30.450908 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Project-Domain-Id: default Jul 01 04:06:30.450908 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Project-Domain-Name: Default Jul 01 04:06:30.450908 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Project-Id: f0143140d4f649478e36abcee284640c Jul 01 04:06:30.450908 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-508791321 Jul 01 04:06:30.450908 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Role: reader,member Jul 01 04:06:30.450908 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Roles: reader,member Jul 01 04:06:30.453832 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/f0143140d4f649478e36abcee284640c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_f0143140d4f649478e36abcee284640c", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f0143140d4f649478e36abcee284640c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f0143140d4f649478e36abcee284640c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}] Jul 01 04:06:30.453832 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Tenant: tempest-ServerRescueNegativeTestJSON-508791321 Jul 01 04:06:30.453832 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Tenant-Id: f0143140d4f649478e36abcee284640c Jul 01 04:06:30.453832 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-508791321 Jul 01 04:06:30.453832 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-User: tempest-ServerRescueNegativeTestJSON-508791321-project Jul 01 04:06:30.453832 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-User-Domain-Id: default Jul 01 04:06:30.453832 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-User-Domain-Name: Default Jul 01 04:06:30.453832 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-User-Id: 8622ec5212c84d87b9b7c8f725012a07 Jul 01 04:06:30.453832 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-User-Name: tempest-ServerRescueNegativeTestJSON-508791321-project Jul 01 04:06:30.453832 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: Jul 01 04:06:30.453832 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: {"volumeAttachment": {"volumeId": "5d925015-f73b-4cc2-9c93-7963d62b1d4a"}} Jul 01 04:06:30.453832 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: method: > Jul 01 04:06:30.454708 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: exception: Cannot 'attach_volume' instance cd6bb9ca-aa57-4dc3-98bc-8e3194003673 while it is in vm_state rescued Jul 01 04:06:30.454708 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: action_args: {'server_id': 'cd6bb9ca-aa57-4dc3-98bc-8e3194003673', 'body': {'volumeAttachment': {'volumeId': '5d925015-f73b-4cc2-9c93-7963d62b1d4a'}}} Jul 01 04:06:30.454708 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 04:06:30.454708 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 04:06:30.454708 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 01 04:06:30.454708 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 01 04:06:30.454708 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 01 04:06:30.454708 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 01 04:06:30.454708 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 01 04:06:30.454708 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 01 04:06:30.454708 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance cd6bb9ca-aa57-4dc3-98bc-8e3194003673 in vm_state rescued. Cannot attach_volume while the instance is in this state. Jul 01 04:06:30.454708 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi Jul 01 04:06:30.454708 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 04:06:30.454708 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi Jul 01 04:06:30.454708 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 04:06:30.454708 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 04:06:30.454708 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 04:06:30.454708 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 04:06:30.454708 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 04:06:30.463425 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 04:06:30.463425 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 04:06:30.463425 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 01 04:06:30.463425 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 01 04:06:30.463425 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 01 04:06:30.463425 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 01 04:06:30.463425 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 01 04:06:30.463425 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 01 04:06:30.463425 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jul 01 04:06:30.463425 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 01 04:06:30.463425 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 01 04:06:30.463425 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 01 04:06:30.463425 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance cd6bb9ca-aa57-4dc3-98bc-8e3194003673 while it is in vm_state rescued Jul 01 04:06:30.463425 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi Jul 01 04:06:30.463425 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 04:06:30.463425 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi Jul 01 04:06:30.463425 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 04:06:30.463425 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 04:06:30.463425 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 04:06:30.464763 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 04:06:30.464763 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 04:06:30.464763 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance cd6bb9ca-aa57-4dc3-98bc-8e3194003673 while it is in vm_state rescued Jul 01 04:06:30.464763 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi Jul 01 04:06:30.464763 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-0fd5b8ab-c73f-4723-b9aa-7e48c061dd0f tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Returning 409 to user: Cannot 'attach_volume' instance cd6bb9ca-aa57-4dc3-98bc-8e3194003673 while it is in vm_state rescued {{(pid=118712) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 04:06:30.464763 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-0fd5b8ab-c73f-4723-b9aa-7e48c061dd0f tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] 10.222.0.20 "POST /compute/v2.1/servers/cd6bb9ca-aa57-4dc3-98bc-8e3194003673/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.092431 Jul 01 04:06:30.464763 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 120/231] 10.222.0.20 () {60 vars in 1322 bytes} [Fri Jul 1 04:06:30 2022] POST /compute/v2.1/servers/cd6bb9ca-aa57-4dc3-98bc-8e3194003673/os-volume_attachments => generated 152 bytes in 94 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 01 04:06:30.475625 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-e1eec7f7-4fe4-48d1-bd93-0cfa86782a80 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 04:06:30.476489 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-e1eec7f7-4fe4-48d1-bd93-0cfa86782a80 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] [instance: cd6bb9ca-aa57-4dc3-98bc-8e3194003673] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:06:30.486955 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-e1eec7f7-4fe4-48d1-bd93-0cfa86782a80 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:06:30.487586 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-e1eec7f7-4fe4-48d1-bd93-0cfa86782a80 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:06:30.489014 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-e1eec7f7-4fe4-48d1-bd93-0cfa86782a80 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:06:30.489725 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-e1eec7f7-4fe4-48d1-bd93-0cfa86782a80 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:06:30.510253 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-4c528cae-ff56-477d-a0ad-dee04f7e922d tempest-VolumesNegativeTest-1967533761 tempest-VolumesNegativeTest-1967533761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6515163518749d3bbe6e3eeda0a4019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12c54764cae34c12b35a6939f96aad5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:06:30.523771 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-4c528cae-ff56-477d-a0ad-dee04f7e922d tempest-VolumesNegativeTest-1967533761 tempest-VolumesNegativeTest-1967533761-project] 10.222.0.20 "GET /compute/v2.1/servers/596d6cbe-bb44-4001-ad9c-56492619071a" status: 200 len: 1300 microversion: 2.1 time: 0.254739 Jul 01 04:06:30.551443 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 112/232] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:06:30 2022] GET /compute/v2.1/servers/596d6cbe-bb44-4001-ad9c-56492619071a => generated 1300 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:06:30.802009 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-e1eec7f7-4fe4-48d1-bd93-0cfa86782a80 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] 10.222.0.20 "POST /compute/v2.1/servers/cd6bb9ca-aa57-4dc3-98bc-8e3194003673/action" status: 202 len: 0 microversion: 2.1 time: 0.335053 Jul 01 04:06:30.803625 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 121/233] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Jul 1 04:06:30 2022] POST /compute/v2.1/servers/cd6bb9ca-aa57-4dc3-98bc-8e3194003673/action => generated 0 bytes in 338 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 01 04:06:30.823394 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-04205810-f45f-40f9-a473-b706d4fb7c7b tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:06:30.824294 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-04205810-f45f-40f9-a473-b706d4fb7c7b tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] [instance: cd6bb9ca-aa57-4dc3-98bc-8e3194003673] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:06:30.835759 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-04205810-f45f-40f9-a473-b706d4fb7c7b tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:06:30.837992 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-04205810-f45f-40f9-a473-b706d4fb7c7b tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:06:30.844075 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-04205810-f45f-40f9-a473-b706d4fb7c7b tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:06:30.844792 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-04205810-f45f-40f9-a473-b706d4fb7c7b tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:06:31.134328 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-04205810-f45f-40f9-a473-b706d4fb7c7b tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8622ec5212c84d87b9b7c8f725012a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0143140d4f649478e36abcee284640c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:06:31.158641 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-04205810-f45f-40f9-a473-b706d4fb7c7b tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] 10.222.0.20 "GET /compute/v2.1/servers/cd6bb9ca-aa57-4dc3-98bc-8e3194003673" status: 200 len: 1511 microversion: 2.1 time: 0.338927 Jul 01 04:06:31.158641 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 113/234] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:06:30 2022] GET /compute/v2.1/servers/cd6bb9ca-aa57-4dc3-98bc-8e3194003673 => generated 1511 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:06:31.305775 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-07e6ccc5-1a5c-4fb8-acb3-67804b970320 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:06:31.307843 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-07e6ccc5-1a5c-4fb8-acb3-67804b970320 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] [instance: b904f233-887c-4c96-a2d2-f7f415ad852f] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:06:31.320563 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-07e6ccc5-1a5c-4fb8-acb3-67804b970320 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:06:31.321651 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-07e6ccc5-1a5c-4fb8-acb3-67804b970320 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:06:31.323731 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-07e6ccc5-1a5c-4fb8-acb3-67804b970320 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:06:31.325000 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-07e6ccc5-1a5c-4fb8-acb3-67804b970320 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:06:31.565338 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-e7311ab4-7e2e-4ce1-81d1-5f41c04fb785 tempest-VolumesNegativeTest-1967533761 tempest-VolumesNegativeTest-1967533761-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:06:31.574380 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-e7311ab4-7e2e-4ce1-81d1-5f41c04fb785 tempest-VolumesNegativeTest-1967533761 tempest-VolumesNegativeTest-1967533761-project] [instance: 596d6cbe-bb44-4001-ad9c-56492619071a] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:06:31.593315 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-e7311ab4-7e2e-4ce1-81d1-5f41c04fb785 tempest-VolumesNegativeTest-1967533761 tempest-VolumesNegativeTest-1967533761-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:06:31.600787 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-e7311ab4-7e2e-4ce1-81d1-5f41c04fb785 tempest-VolumesNegativeTest-1967533761 tempest-VolumesNegativeTest-1967533761-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:06:31.603769 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-e7311ab4-7e2e-4ce1-81d1-5f41c04fb785 tempest-VolumesNegativeTest-1967533761 tempest-VolumesNegativeTest-1967533761-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:06:31.604835 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-e7311ab4-7e2e-4ce1-81d1-5f41c04fb785 tempest-VolumesNegativeTest-1967533761 tempest-VolumesNegativeTest-1967533761-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:06:31.767670 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-e7311ab4-7e2e-4ce1-81d1-5f41c04fb785 tempest-VolumesNegativeTest-1967533761 tempest-VolumesNegativeTest-1967533761-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:06:31.768418 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-e7311ab4-7e2e-4ce1-81d1-5f41c04fb785 tempest-VolumesNegativeTest-1967533761 tempest-VolumesNegativeTest-1967533761-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:06:31.769198 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.objects.instance [None req-e7311ab4-7e2e-4ce1-81d1-5f41c04fb785 tempest-VolumesNegativeTest-1967533761 tempest-VolumesNegativeTest-1967533761-project] Lazy-loading 'fault' on Instance uuid 596d6cbe-bb44-4001-ad9c-56492619071a {{(pid=118711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 04:06:31.813436 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-07e6ccc5-1a5c-4fb8-acb3-67804b970320 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:06:31.842725 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-07e6ccc5-1a5c-4fb8-acb3-67804b970320 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:06:31.854861 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-07e6ccc5-1a5c-4fb8-acb3-67804b970320 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:06:31.857790 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-07e6ccc5-1a5c-4fb8-acb3-67804b970320 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] 10.222.0.20 "GET /compute/v2.1/servers/b904f233-887c-4c96-a2d2-f7f415ad852f" status: 200 len: 1723 microversion: 2.20 time: 0.563167 Jul 01 04:06:31.858804 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 122/235] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Jul 1 04:06:31 2022] GET /compute/v2.1/servers/b904f233-887c-4c96-a2d2-f7f415ad852f => generated 1723 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 04:06:31.971914 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-e7311ab4-7e2e-4ce1-81d1-5f41c04fb785 tempest-VolumesNegativeTest-1967533761 tempest-VolumesNegativeTest-1967533761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6515163518749d3bbe6e3eeda0a4019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12c54764cae34c12b35a6939f96aad5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:06:32.021098 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-e7311ab4-7e2e-4ce1-81d1-5f41c04fb785 tempest-VolumesNegativeTest-1967533761 tempest-VolumesNegativeTest-1967533761-project] 10.222.0.20 "GET /compute/v2.1/servers/596d6cbe-bb44-4001-ad9c-56492619071a" status: 200 len: 1305 microversion: 2.1 time: 0.440093 Jul 01 04:06:32.024829 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 114/236] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:06:31 2022] GET /compute/v2.1/servers/596d6cbe-bb44-4001-ad9c-56492619071a => generated 1305 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:06:32.172231 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-a4e781fd-bdf5-4079-b6d3-cd7b1e5667e4 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:06:32.173554 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-a4e781fd-bdf5-4079-b6d3-cd7b1e5667e4 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] [instance: cd6bb9ca-aa57-4dc3-98bc-8e3194003673] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:06:32.197606 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-a4e781fd-bdf5-4079-b6d3-cd7b1e5667e4 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:06:32.199299 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-a4e781fd-bdf5-4079-b6d3-cd7b1e5667e4 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:06:32.206424 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-a4e781fd-bdf5-4079-b6d3-cd7b1e5667e4 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:06:32.208483 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-a4e781fd-bdf5-4079-b6d3-cd7b1e5667e4 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:06:32.548263 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-a4e781fd-bdf5-4079-b6d3-cd7b1e5667e4 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8622ec5212c84d87b9b7c8f725012a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0143140d4f649478e36abcee284640c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:06:32.571983 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-a4e781fd-bdf5-4079-b6d3-cd7b1e5667e4 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] 10.222.0.20 "GET /compute/v2.1/servers/cd6bb9ca-aa57-4dc3-98bc-8e3194003673" status: 200 len: 1511 microversion: 2.1 time: 0.403774 Jul 01 04:06:32.590712 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 123/237] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:06:32 2022] GET /compute/v2.1/servers/cd6bb9ca-aa57-4dc3-98bc-8e3194003673 => generated 1511 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:06:32.879889 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-f9411156-ed34-4a85-b35b-e403f3025dc8 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:06:32.880992 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-f9411156-ed34-4a85-b35b-e403f3025dc8 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] [instance: b904f233-887c-4c96-a2d2-f7f415ad852f] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:06:32.893037 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-f9411156-ed34-4a85-b35b-e403f3025dc8 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:06:32.893841 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-f9411156-ed34-4a85-b35b-e403f3025dc8 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:06:32.895195 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-f9411156-ed34-4a85-b35b-e403f3025dc8 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:06:32.897324 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-f9411156-ed34-4a85-b35b-e403f3025dc8 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:06:33.043218 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-3352fd65-a50a-4e2b-8379-d8561a915627 tempest-VolumesNegativeTest-1967533761 tempest-VolumesNegativeTest-1967533761-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:06:33.044054 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-3352fd65-a50a-4e2b-8379-d8561a915627 tempest-VolumesNegativeTest-1967533761 tempest-VolumesNegativeTest-1967533761-project] [instance: 596d6cbe-bb44-4001-ad9c-56492619071a] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:06:33.052973 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-3352fd65-a50a-4e2b-8379-d8561a915627 tempest-VolumesNegativeTest-1967533761 tempest-VolumesNegativeTest-1967533761-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:06:33.053526 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-3352fd65-a50a-4e2b-8379-d8561a915627 tempest-VolumesNegativeTest-1967533761 tempest-VolumesNegativeTest-1967533761-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:06:33.054673 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-3352fd65-a50a-4e2b-8379-d8561a915627 tempest-VolumesNegativeTest-1967533761 tempest-VolumesNegativeTest-1967533761-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:06:33.055313 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-3352fd65-a50a-4e2b-8379-d8561a915627 tempest-VolumesNegativeTest-1967533761 tempest-VolumesNegativeTest-1967533761-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:06:33.081344 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.wsgi [None req-3352fd65-a50a-4e2b-8379-d8561a915627 tempest-VolumesNegativeTest-1967533761 tempest-VolumesNegativeTest-1967533761-project] HTTP exception thrown: Instance 596d6cbe-bb44-4001-ad9c-56492619071a could not be found. Jul 01 04:06:33.083793 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-3352fd65-a50a-4e2b-8379-d8561a915627 tempest-VolumesNegativeTest-1967533761 tempest-VolumesNegativeTest-1967533761-project] Request method failure captured: Jul 01 04:06:33.083793 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: request: GET /compute/v2.1/servers/596d6cbe-bb44-4001-ad9c-56492619071a HTTP/1.1 Jul 01 04:06:33.083793 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: Accept: application/json Jul 01 04:06:33.083793 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: Accept-Encoding: identity Jul 01 04:06:33.083793 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: Connection: close Jul 01 04:06:33.083793 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: Content-Length: 0 Jul 01 04:06:33.083793 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: Content-Type: application/json Jul 01 04:06:33.083793 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: Host: 10.222.0.20 Jul 01 04:06:33.083793 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: Openstack-System-Scope: None Jul 01 04:06:33.083793 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: User-Agent: python-urllib3/1.26.9 Jul 01 04:06:33.083793 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Auth-Token: gAAAAABivnKmrkPzVp1QKNUgB9vuCsicKsC6J3DeMF-SyvLi2fAlQ5Fs49Uo5dXgwuw-OKCjC9fGQRf82gkioOBjppu1nvJ1dVH9oM-zctXwvBEK9Lx-jycO5rvTLTt5xjqPNsU7aPU0zTzQ1tjpmfLtHL_zeqDkl9X_IokDs_U3DwM_CIhxHjM Jul 01 04:06:33.083793 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Domain-Id: None Jul 01 04:06:33.083793 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Domain-Name: None Jul 01 04:06:33.083793 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Identity-Status: Confirmed Jul 01 04:06:33.083793 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Is-Admin-Project: True Jul 01 04:06:33.083793 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Project-Domain-Id: default Jul 01 04:06:33.083793 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Project-Domain-Name: Default Jul 01 04:06:33.083793 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Project-Id: 12c54764cae34c12b35a6939f96aad5c Jul 01 04:06:33.083793 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Project-Name: tempest-VolumesNegativeTest-1967533761 Jul 01 04:06:33.083793 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Role: reader,member Jul 01 04:06:33.083793 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Roles: reader,member Jul 01 04:06:33.085578 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/12c54764cae34c12b35a6939f96aad5c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_12c54764cae34c12b35a6939f96aad5c", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/12c54764cae34c12b35a6939f96aad5c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/12c54764cae34c12b35a6939f96aad5c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}] Jul 01 04:06:33.085578 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Tenant: tempest-VolumesNegativeTest-1967533761 Jul 01 04:06:33.085578 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Tenant-Id: 12c54764cae34c12b35a6939f96aad5c Jul 01 04:06:33.085578 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Tenant-Name: tempest-VolumesNegativeTest-1967533761 Jul 01 04:06:33.085578 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-User: tempest-VolumesNegativeTest-1967533761-project Jul 01 04:06:33.085578 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-User-Domain-Id: default Jul 01 04:06:33.085578 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-User-Domain-Name: Default Jul 01 04:06:33.085578 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-User-Id: d6515163518749d3bbe6e3eeda0a4019 Jul 01 04:06:33.085578 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-User-Name: tempest-VolumesNegativeTest-1967533761-project Jul 01 04:06:33.085578 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: method: > Jul 01 04:06:33.085578 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: exception: Instance 596d6cbe-bb44-4001-ad9c-56492619071a could not be found. Jul 01 04:06:33.085578 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: action_args: {'id': '596d6cbe-bb44-4001-ad9c-56492619071a'} Jul 01 04:06:33.086540 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 04:06:33.086540 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 04:06:33.086540 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 04:06:33.086540 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 04:06:33.086540 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 04:06:33.086540 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 04:06:33.086540 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 04:06:33.086540 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 04:06:33.086540 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 04:06:33.086540 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 04:06:33.086540 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 596d6cbe-bb44-4001-ad9c-56492619071a could not be found. Jul 01 04:06:33.086540 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi Jul 01 04:06:33.086540 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 04:06:33.086540 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi Jul 01 04:06:33.086540 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 04:06:33.086540 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 04:06:33.086540 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 04:06:33.086540 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 04:06:33.086540 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 04:06:33.086540 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 04:06:33.087947 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 04:06:33.087947 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 04:06:33.087947 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 04:06:33.087947 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 04:06:33.087947 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 04:06:33.087947 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 04:06:33.087947 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 04:06:33.087947 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 596d6cbe-bb44-4001-ad9c-56492619071a could not be found. Jul 01 04:06:33.087947 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi Jul 01 04:06:33.087947 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 04:06:33.087947 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi Jul 01 04:06:33.087947 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 04:06:33.087947 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 04:06:33.087947 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 04:06:33.087947 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 04:06:33.087947 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 04:06:33.087947 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 596d6cbe-bb44-4001-ad9c-56492619071a could not be found. Jul 01 04:06:33.087947 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi Jul 01 04:06:33.090289 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-3352fd65-a50a-4e2b-8379-d8561a915627 tempest-VolumesNegativeTest-1967533761 tempest-VolumesNegativeTest-1967533761-project] Returning 404 to user: Instance 596d6cbe-bb44-4001-ad9c-56492619071a could not be found. {{(pid=118712) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 04:06:33.091406 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-3352fd65-a50a-4e2b-8379-d8561a915627 tempest-VolumesNegativeTest-1967533761 tempest-VolumesNegativeTest-1967533761-project] 10.222.0.20 "GET /compute/v2.1/servers/596d6cbe-bb44-4001-ad9c-56492619071a" status: 404 len: 111 microversion: 2.1 time: 0.053505 Jul 01 04:06:33.092147 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 124/238] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:06:33 2022] GET /compute/v2.1/servers/596d6cbe-bb44-4001-ad9c-56492619071a => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 01 04:06:33.191819 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-f9411156-ed34-4a85-b35b-e403f3025dc8 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:06:33.202663 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-f9411156-ed34-4a85-b35b-e403f3025dc8 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:06:33.204578 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-f9411156-ed34-4a85-b35b-e403f3025dc8 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:06:33.205887 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-f9411156-ed34-4a85-b35b-e403f3025dc8 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] 10.222.0.20 "GET /compute/v2.1/servers/b904f233-887c-4c96-a2d2-f7f415ad852f" status: 200 len: 1723 microversion: 2.20 time: 0.332801 Jul 01 04:06:33.206693 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 115/239] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Jul 1 04:06:32 2022] GET /compute/v2.1/servers/b904f233-887c-4c96-a2d2-f7f415ad852f => generated 1723 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 04:06:33.610380 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-8b42ec9c-ed19-4020-ac94-106d820d8bdf tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:06:33.610380 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-8b42ec9c-ed19-4020-ac94-106d820d8bdf tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] [instance: cd6bb9ca-aa57-4dc3-98bc-8e3194003673] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:06:33.618644 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-8b42ec9c-ed19-4020-ac94-106d820d8bdf tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:06:33.619459 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-8b42ec9c-ed19-4020-ac94-106d820d8bdf tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:06:33.620527 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-8b42ec9c-ed19-4020-ac94-106d820d8bdf tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:06:33.621227 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-8b42ec9c-ed19-4020-ac94-106d820d8bdf tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:06:33.955851 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-8b42ec9c-ed19-4020-ac94-106d820d8bdf tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8622ec5212c84d87b9b7c8f725012a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0143140d4f649478e36abcee284640c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:06:33.968854 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-8b42ec9c-ed19-4020-ac94-106d820d8bdf tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] 10.222.0.20 "GET /compute/v2.1/servers/cd6bb9ca-aa57-4dc3-98bc-8e3194003673" status: 200 len: 1511 microversion: 2.1 time: 0.369306 Jul 01 04:06:33.969471 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 125/240] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:06:33 2022] GET /compute/v2.1/servers/cd6bb9ca-aa57-4dc3-98bc-8e3194003673 => generated 1511 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:06:34.234392 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-debd6290-8776-41cd-b11d-2f0b3e582050 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:06:34.235025 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-debd6290-8776-41cd-b11d-2f0b3e582050 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] [instance: b904f233-887c-4c96-a2d2-f7f415ad852f] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:06:34.247090 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-debd6290-8776-41cd-b11d-2f0b3e582050 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:06:34.247615 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-debd6290-8776-41cd-b11d-2f0b3e582050 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:06:34.269168 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-debd6290-8776-41cd-b11d-2f0b3e582050 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:06:34.269629 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-debd6290-8776-41cd-b11d-2f0b3e582050 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:06:34.466899 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-debd6290-8776-41cd-b11d-2f0b3e582050 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:06:34.485764 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-debd6290-8776-41cd-b11d-2f0b3e582050 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:06:34.488961 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-debd6290-8776-41cd-b11d-2f0b3e582050 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:06:34.492254 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-debd6290-8776-41cd-b11d-2f0b3e582050 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] 10.222.0.20 "GET /compute/v2.1/servers/b904f233-887c-4c96-a2d2-f7f415ad852f" status: 200 len: 1723 microversion: 2.20 time: 0.261114 Jul 01 04:06:34.493818 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 116/241] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Jul 1 04:06:34 2022] GET /compute/v2.1/servers/b904f233-887c-4c96-a2d2-f7f415ad852f => generated 1723 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 04:06:35.014513 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-f4a6cd6f-e836-4738-afda-37b3124d7a6b tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:06:35.016412 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-f4a6cd6f-e836-4738-afda-37b3124d7a6b tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] [instance: cd6bb9ca-aa57-4dc3-98bc-8e3194003673] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:06:35.027098 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-f4a6cd6f-e836-4738-afda-37b3124d7a6b tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:06:35.028399 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-f4a6cd6f-e836-4738-afda-37b3124d7a6b tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:06:35.030376 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-f4a6cd6f-e836-4738-afda-37b3124d7a6b tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:06:35.032108 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-f4a6cd6f-e836-4738-afda-37b3124d7a6b tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:06:35.527059 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-2e81acd8-157c-4d7e-99bf-e8cb11c1d533 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:06:35.529962 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-2e81acd8-157c-4d7e-99bf-e8cb11c1d533 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] [instance: b904f233-887c-4c96-a2d2-f7f415ad852f] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:06:35.606253 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-2e81acd8-157c-4d7e-99bf-e8cb11c1d533 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:06:35.607201 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-2e81acd8-157c-4d7e-99bf-e8cb11c1d533 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:06:35.608721 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-2e81acd8-157c-4d7e-99bf-e8cb11c1d533 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:06:35.621714 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-2e81acd8-157c-4d7e-99bf-e8cb11c1d533 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:06:35.759117 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-f4a6cd6f-e836-4738-afda-37b3124d7a6b tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8622ec5212c84d87b9b7c8f725012a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0143140d4f649478e36abcee284640c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:06:35.769978 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-f4a6cd6f-e836-4738-afda-37b3124d7a6b tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] 10.222.0.20 "GET /compute/v2.1/servers/cd6bb9ca-aa57-4dc3-98bc-8e3194003673" status: 200 len: 1511 microversion: 2.1 time: 0.785791 Jul 01 04:06:35.780823 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 126/242] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:06:34 2022] GET /compute/v2.1/servers/cd6bb9ca-aa57-4dc3-98bc-8e3194003673 => generated 1511 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:06:36.205308 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-2e81acd8-157c-4d7e-99bf-e8cb11c1d533 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:06:36.215402 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-2e81acd8-157c-4d7e-99bf-e8cb11c1d533 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:06:36.225381 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-2e81acd8-157c-4d7e-99bf-e8cb11c1d533 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:06:36.226626 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-2e81acd8-157c-4d7e-99bf-e8cb11c1d533 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] 10.222.0.20 "GET /compute/v2.1/servers/b904f233-887c-4c96-a2d2-f7f415ad852f" status: 200 len: 1744 microversion: 2.20 time: 0.709920 Jul 01 04:06:36.238252 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 117/243] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Jul 1 04:06:35 2022] GET /compute/v2.1/servers/b904f233-887c-4c96-a2d2-f7f415ad852f => generated 1744 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 01 04:06:36.789280 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-01f5dae2-2983-4901-b99f-609d471aacda tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:06:36.790039 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-01f5dae2-2983-4901-b99f-609d471aacda tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] [instance: cd6bb9ca-aa57-4dc3-98bc-8e3194003673] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:06:36.803739 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-01f5dae2-2983-4901-b99f-609d471aacda tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:06:36.804255 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-01f5dae2-2983-4901-b99f-609d471aacda tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:06:36.805045 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-01f5dae2-2983-4901-b99f-609d471aacda tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:06:36.805486 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-01f5dae2-2983-4901-b99f-609d471aacda tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:06:37.251122 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-dc994acc-91b4-44c2-8cf7-304be8903463 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:06:37.251809 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-dc994acc-91b4-44c2-8cf7-304be8903463 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] [instance: b904f233-887c-4c96-a2d2-f7f415ad852f] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:06:37.269991 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-dc994acc-91b4-44c2-8cf7-304be8903463 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:06:37.272809 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-dc994acc-91b4-44c2-8cf7-304be8903463 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:06:37.275694 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-dc994acc-91b4-44c2-8cf7-304be8903463 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:06:37.279919 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-dc994acc-91b4-44c2-8cf7-304be8903463 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:06:37.389461 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-01f5dae2-2983-4901-b99f-609d471aacda tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8622ec5212c84d87b9b7c8f725012a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0143140d4f649478e36abcee284640c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:06:37.408993 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-01f5dae2-2983-4901-b99f-609d471aacda tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] 10.222.0.20 "GET /compute/v2.1/servers/cd6bb9ca-aa57-4dc3-98bc-8e3194003673" status: 200 len: 1517 microversion: 2.1 time: 0.624027 Jul 01 04:06:37.413174 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 127/244] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:06:36 2022] GET /compute/v2.1/servers/cd6bb9ca-aa57-4dc3-98bc-8e3194003673 => generated 1517 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:06:37.748106 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-dc994acc-91b4-44c2-8cf7-304be8903463 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:06:37.776263 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-dc994acc-91b4-44c2-8cf7-304be8903463 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:06:37.776263 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-dc994acc-91b4-44c2-8cf7-304be8903463 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:06:37.776263 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-dc994acc-91b4-44c2-8cf7-304be8903463 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] 10.222.0.20 "GET /compute/v2.1/servers/b904f233-887c-4c96-a2d2-f7f415ad852f" status: 200 len: 1744 microversion: 2.20 time: 0.533200 Jul 01 04:06:37.791443 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 118/245] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Jul 1 04:06:37 2022] GET /compute/v2.1/servers/b904f233-887c-4c96-a2d2-f7f415ad852f => generated 1744 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 01 04:06:38.704152 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [req-29031898-4b65-477c-b7a1-41ba4626f683 req-27f34e16-3ab2-415d-82bd-fe5b3c62bb01 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b904f233-887c-4c96-a2d2-f7f415ad852f", "name": "network-vif-plugged", "status": "completed", "tag": "b1d88871-2b18-4397-8234-7831054c30f0"}]} {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 04:06:38.720476 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [req-29031898-4b65-477c-b7a1-41ba4626f683 req-27f34e16-3ab2-415d-82bd-fe5b3c62bb01 service nova] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:06:38.721577 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [req-29031898-4b65-477c-b7a1-41ba4626f683 req-27f34e16-3ab2-415d-82bd-fe5b3c62bb01 service nova] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:06:38.752656 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.compute.server_external_events [req-29031898-4b65-477c-b7a1-41ba4626f683 req-27f34e16-3ab2-415d-82bd-fe5b3c62bb01 service nova] Creating event network-vif-plugged:b1d88871-2b18-4397-8234-7831054c30f0 for instance b904f233-887c-4c96-a2d2-f7f415ad852f on hv-cinder-84684 Jul 01 04:06:38.762503 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [req-29031898-4b65-477c-b7a1-41ba4626f683 req-27f34e16-3ab2-415d-82bd-fe5b3c62bb01 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059584 Jul 01 04:06:38.762503 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 128/246] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Jul 1 04:06:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 01 04:06:38.816165 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-ba116c03-22be-42e5-851b-9d903bd6b886 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:06:38.817164 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-ba116c03-22be-42e5-851b-9d903bd6b886 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] [instance: b904f233-887c-4c96-a2d2-f7f415ad852f] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:06:38.825009 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-ba116c03-22be-42e5-851b-9d903bd6b886 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:06:38.826016 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-ba116c03-22be-42e5-851b-9d903bd6b886 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:06:38.826859 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-ba116c03-22be-42e5-851b-9d903bd6b886 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:06:38.827336 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-ba116c03-22be-42e5-851b-9d903bd6b886 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:06:39.215342 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-ba116c03-22be-42e5-851b-9d903bd6b886 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:06:39.239832 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-ba116c03-22be-42e5-851b-9d903bd6b886 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:06:39.239832 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-ba116c03-22be-42e5-851b-9d903bd6b886 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:06:39.239832 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-ba116c03-22be-42e5-851b-9d903bd6b886 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] 10.222.0.20 "GET /compute/v2.1/servers/b904f233-887c-4c96-a2d2-f7f415ad852f" status: 200 len: 1739 microversion: 2.20 time: 0.418502 Jul 01 04:06:39.243363 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 119/247] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Jul 1 04:06:38 2022] GET /compute/v2.1/servers/b904f233-887c-4c96-a2d2-f7f415ad852f => generated 1739 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 04:06:40.253544 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-d876c5cc-4f23-4e4f-b340-9a2ffeeff204 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:06:40.256483 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-d876c5cc-4f23-4e4f-b340-9a2ffeeff204 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] [instance: b904f233-887c-4c96-a2d2-f7f415ad852f] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:06:40.280638 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-d876c5cc-4f23-4e4f-b340-9a2ffeeff204 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:06:40.281123 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-d876c5cc-4f23-4e4f-b340-9a2ffeeff204 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:06:40.281934 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-d876c5cc-4f23-4e4f-b340-9a2ffeeff204 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:06:40.282377 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-d876c5cc-4f23-4e4f-b340-9a2ffeeff204 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:06:40.710214 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-a47adce3-b58a-4353-839f-21fab5b1be27 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Action: 'create', calling method: .version_select at 0x7f99a09a88b0>, body: {"keypair": {"name": "tempest-keypair-1631497420", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOuXv27/mXsUWHq8DFEskz4EEUfNCYK83n7IEjZ/TBrca67BugnMdPgjU5lhFHNB3Hji3U6QjKtxl5PmqgRJ6L3o9hEJoGVoluiU9FGRP9m8dekgC4HEvky+vi3AC9ttpg=="}} {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 04:06:40.741907 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.quota [None req-a47adce3-b58a-4353-839f-21fab5b1be27 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Getting quotas for project f0143140d4f649478e36abcee284640c. Resources: {'key_pairs'} {{(pid=118711) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 04:06:40.752904 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.quota [None req-a47adce3-b58a-4353-839f-21fab5b1be27 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Getting quotas for user 8622ec5212c84d87b9b7c8f725012a07 and project f0143140d4f649478e36abcee284640c. Resources: {'key_pairs'} {{(pid=118711) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 04:06:40.918885 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-a47adce3-b58a-4353-839f-21fab5b1be27 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.221535 Jul 01 04:06:40.921965 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 120/248] 10.222.0.20 () {60 vars in 1158 bytes} [Fri Jul 1 04:06:40 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 04:06:41.058877 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-d876c5cc-4f23-4e4f-b340-9a2ffeeff204 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:06:41.083886 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-d876c5cc-4f23-4e4f-b340-9a2ffeeff204 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:06:41.086265 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-d876c5cc-4f23-4e4f-b340-9a2ffeeff204 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:06:41.087789 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-d876c5cc-4f23-4e4f-b340-9a2ffeeff204 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] 10.222.0.20 "GET /compute/v2.1/servers/b904f233-887c-4c96-a2d2-f7f415ad852f" status: 200 len: 1739 microversion: 2.20 time: 0.840287 Jul 01 04:06:41.089296 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 129/249] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Jul 1 04:06:40 2022] GET /compute/v2.1/servers/b904f233-887c-4c96-a2d2-f7f415ad852f => generated 1739 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 04:06:42.124867 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-d5237169-3567-442e-b9eb-6b95c6e8a522 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:06:42.125560 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-d5237169-3567-442e-b9eb-6b95c6e8a522 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] [instance: b904f233-887c-4c96-a2d2-f7f415ad852f] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:06:42.141347 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-d5237169-3567-442e-b9eb-6b95c6e8a522 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:06:42.144163 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-d5237169-3567-442e-b9eb-6b95c6e8a522 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:06:42.145469 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-d5237169-3567-442e-b9eb-6b95c6e8a522 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:06:42.146157 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-d5237169-3567-442e-b9eb-6b95c6e8a522 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:06:42.467034 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-d5237169-3567-442e-b9eb-6b95c6e8a522 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:06:42.492792 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-d5237169-3567-442e-b9eb-6b95c6e8a522 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:06:42.496004 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-d5237169-3567-442e-b9eb-6b95c6e8a522 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:06:42.503839 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-d5237169-3567-442e-b9eb-6b95c6e8a522 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] 10.222.0.20 "GET /compute/v2.1/servers/b904f233-887c-4c96-a2d2-f7f415ad852f" status: 200 len: 1739 microversion: 2.20 time: 0.386317 Jul 01 04:06:42.515685 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 121/250] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Jul 1 04:06:42 2022] GET /compute/v2.1/servers/b904f233-887c-4c96-a2d2-f7f415ad852f => generated 1739 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 01 04:06:43.538483 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-bb82b076-be72-4b2f-8f12-b3bb5d0b44e2 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:06:43.539955 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-bb82b076-be72-4b2f-8f12-b3bb5d0b44e2 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] [instance: b904f233-887c-4c96-a2d2-f7f415ad852f] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:06:43.556976 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-bb82b076-be72-4b2f-8f12-b3bb5d0b44e2 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:06:43.557837 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-bb82b076-be72-4b2f-8f12-b3bb5d0b44e2 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:06:43.558919 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-bb82b076-be72-4b2f-8f12-b3bb5d0b44e2 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:06:43.559684 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-bb82b076-be72-4b2f-8f12-b3bb5d0b44e2 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:06:44.013735 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-bb82b076-be72-4b2f-8f12-b3bb5d0b44e2 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:06:44.030070 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-bb82b076-be72-4b2f-8f12-b3bb5d0b44e2 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:06:44.034057 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-bb82b076-be72-4b2f-8f12-b3bb5d0b44e2 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:06:44.056744 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-bb82b076-be72-4b2f-8f12-b3bb5d0b44e2 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] 10.222.0.20 "GET /compute/v2.1/servers/b904f233-887c-4c96-a2d2-f7f415ad852f" status: 200 len: 1739 microversion: 2.20 time: 0.503281 Jul 01 04:06:44.056744 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 130/251] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Jul 1 04:06:43 2022] GET /compute/v2.1/servers/b904f233-887c-4c96-a2d2-f7f415ad852f => generated 1739 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 04:06:45.064536 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-66a5da9b-66ed-4315-8711-c6ece575ea26 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:06:45.065875 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-66a5da9b-66ed-4315-8711-c6ece575ea26 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] [instance: b904f233-887c-4c96-a2d2-f7f415ad852f] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:06:45.072982 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG dbcounter [-] [118711] Writing DB stats nova_api:SELECT=69,nova_api:INSERT=1 {{(pid=118711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:06:45.088043 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-66a5da9b-66ed-4315-8711-c6ece575ea26 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:06:45.088787 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-66a5da9b-66ed-4315-8711-c6ece575ea26 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:06:45.093434 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-66a5da9b-66ed-4315-8711-c6ece575ea26 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:06:45.094407 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-66a5da9b-66ed-4315-8711-c6ece575ea26 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:06:45.625211 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-66a5da9b-66ed-4315-8711-c6ece575ea26 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:06:45.650699 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-66a5da9b-66ed-4315-8711-c6ece575ea26 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:06:45.659218 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-66a5da9b-66ed-4315-8711-c6ece575ea26 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:06:45.669648 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-66a5da9b-66ed-4315-8711-c6ece575ea26 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] 10.222.0.20 "GET /compute/v2.1/servers/b904f233-887c-4c96-a2d2-f7f415ad852f" status: 200 len: 1739 microversion: 2.20 time: 0.609530 Jul 01 04:06:45.670795 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 122/252] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Jul 1 04:06:45 2022] GET /compute/v2.1/servers/b904f233-887c-4c96-a2d2-f7f415ad852f => generated 1739 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 04:06:46.605776 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-fb682fab-79d1-4349-8b96-41688c239176 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-200941006", "imageRef": "66f9f4ba-339c-4967-8857-d65299a66629", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "75365ee4-4f3f-4dcc-b151-ec870f7f38ce"}], "security_groups": [{"name": "tempest-securitygroup--1941641831"}], "key_name": "tempest-keypair-1631497420", "user_data": "}} {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 04:06:46.717874 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-cd316fe8-fede-4848-9acf-a66df18a1402 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:06:46.718624 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-cd316fe8-fede-4848-9acf-a66df18a1402 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] [instance: b904f233-887c-4c96-a2d2-f7f415ad852f] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:06:46.740804 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-cd316fe8-fede-4848-9acf-a66df18a1402 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:06:46.741258 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-cd316fe8-fede-4848-9acf-a66df18a1402 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:06:46.742273 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-cd316fe8-fede-4848-9acf-a66df18a1402 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:06:46.742892 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-cd316fe8-fede-4848-9acf-a66df18a1402 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:06:46.840824 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.network.neutron [None req-fb682fab-79d1-4349-8b96-41688c239176 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] validate_networks() for [('75365ee4-4f3f-4dcc-b151-ec870f7f38ce', None, None, None, None, None)] {{(pid=118712) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 01 04:06:47.011087 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-cd316fe8-fede-4848-9acf-a66df18a1402 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:06:47.026032 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-cd316fe8-fede-4848-9acf-a66df18a1402 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:06:47.030669 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-cd316fe8-fede-4848-9acf-a66df18a1402 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:06:47.032287 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-cd316fe8-fede-4848-9acf-a66df18a1402 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] 10.222.0.20 "GET /compute/v2.1/servers/b904f233-887c-4c96-a2d2-f7f415ad852f" status: 200 len: 1739 microversion: 2.20 time: 0.333473 Jul 01 04:06:47.046234 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 123/253] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Jul 1 04:06:46 2022] GET /compute/v2.1/servers/b904f233-887c-4c96-a2d2-f7f415ad852f => generated 1739 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 01 04:06:47.781640 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.virt.hardware [None req-fb682fab-79d1-4349-8b96-41688c239176 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Flavor limits 0:0:0 {{(pid=118712) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 01 04:06:47.782849 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.virt.hardware [None req-fb682fab-79d1-4349-8b96-41688c239176 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Image limits 0:0:0 {{(pid=118712) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 01 04:06:47.783586 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.virt.hardware [None req-fb682fab-79d1-4349-8b96-41688c239176 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Flavor pref 0:0:0 {{(pid=118712) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 01 04:06:47.784212 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.virt.hardware [None req-fb682fab-79d1-4349-8b96-41688c239176 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Image pref 0:0:0 {{(pid=118712) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 01 04:06:47.784853 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.virt.hardware [None req-fb682fab-79d1-4349-8b96-41688c239176 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118712) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 01 04:06:47.807313 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-fb682fab-79d1-4349-8b96-41688c239176 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:06:47.813952 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-fb682fab-79d1-4349-8b96-41688c239176 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:06:47.813952 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-fb682fab-79d1-4349-8b96-41688c239176 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:06:47.813952 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-fb682fab-79d1-4349-8b96-41688c239176 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:06:47.855421 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.quota [None req-fb682fab-79d1-4349-8b96-41688c239176 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Getting quotas for project f0143140d4f649478e36abcee284640c. Resources: {'ram', 'cores', 'instances'} {{(pid=118712) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 04:06:47.870065 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.quota [None req-fb682fab-79d1-4349-8b96-41688c239176 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Getting quotas for user 8622ec5212c84d87b9b7c8f725012a07 and project f0143140d4f649478e36abcee284640c. Resources: {'ram', 'cores', 'instances'} {{(pid=118712) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 04:06:47.892852 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-fb682fab-79d1-4349-8b96-41688c239176 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Going to run 1 instances... {{(pid=118712) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 01 04:06:47.899755 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-fb682fab-79d1-4349-8b96-41688c239176 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] [instance: 1f96263a-e229-447e-aa6b-dd9c2872c751] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='66f9f4ba-339c-4967-8857-d65299a66629',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118712) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 01 04:06:48.060058 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-900d9543-15f9-4ab4-bd52-3762dc6ebade tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:06:48.061051 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-900d9543-15f9-4ab4-bd52-3762dc6ebade tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] [instance: b904f233-887c-4c96-a2d2-f7f415ad852f] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:06:48.084929 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-fb682fab-79d1-4349-8b96-41688c239176 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.490399 Jul 01 04:06:48.091145 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 131/254] 10.222.0.20 () {60 vars in 1146 bytes} [Fri Jul 1 04:06:46 2022] POST /compute/v2.1/servers => generated 409 bytes in 1497 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 01 04:06:48.099617 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-ebad5743-5d10-405a-a12e-e2aafaa445c2 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:06:48.101014 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-ebad5743-5d10-405a-a12e-e2aafaa445c2 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] [instance: 1f96263a-e229-447e-aa6b-dd9c2872c751] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:06:48.104551 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-900d9543-15f9-4ab4-bd52-3762dc6ebade tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:06:48.105346 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-900d9543-15f9-4ab4-bd52-3762dc6ebade tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:06:48.128577 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-900d9543-15f9-4ab4-bd52-3762dc6ebade tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:06:48.128577 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-900d9543-15f9-4ab4-bd52-3762dc6ebade tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:06:48.273983 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-ebad5743-5d10-405a-a12e-e2aafaa445c2 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8622ec5212c84d87b9b7c8f725012a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0143140d4f649478e36abcee284640c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:06:48.333971 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-ebad5743-5d10-405a-a12e-e2aafaa445c2 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] 10.222.0.20 "GET /compute/v2.1/servers/1f96263a-e229-447e-aa6b-dd9c2872c751" status: 200 len: 1245 microversion: 2.1 time: 0.241290 Jul 01 04:06:48.357688 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 132/255] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:06:48 2022] GET /compute/v2.1/servers/1f96263a-e229-447e-aa6b-dd9c2872c751 => generated 1245 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:06:48.503657 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-900d9543-15f9-4ab4-bd52-3762dc6ebade tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:06:48.510300 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG dbcounter [-] [118711] Writing DB stats nova_cell1:SELECT=100 {{(pid=118711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:06:48.544613 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-900d9543-15f9-4ab4-bd52-3762dc6ebade tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:06:48.549839 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-900d9543-15f9-4ab4-bd52-3762dc6ebade tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:06:48.552197 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-900d9543-15f9-4ab4-bd52-3762dc6ebade tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] 10.222.0.20 "GET /compute/v2.1/servers/b904f233-887c-4c96-a2d2-f7f415ad852f" status: 200 len: 1739 microversion: 2.20 time: 0.499355 Jul 01 04:06:48.553552 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 124/256] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Jul 1 04:06:48 2022] GET /compute/v2.1/servers/b904f233-887c-4c96-a2d2-f7f415ad852f => generated 1739 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 04:06:49.368215 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-5a10e807-40e1-4328-a795-eb91d4d579b6 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:06:49.368215 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-5a10e807-40e1-4328-a795-eb91d4d579b6 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] [instance: 1f96263a-e229-447e-aa6b-dd9c2872c751] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:06:49.368976 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG dbcounter [-] [118712] Writing DB stats nova_api:SELECT=80,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=118712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:06:49.487894 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-5a10e807-40e1-4328-a795-eb91d4d579b6 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8622ec5212c84d87b9b7c8f725012a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0143140d4f649478e36abcee284640c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:06:49.498169 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-5a10e807-40e1-4328-a795-eb91d4d579b6 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] 10.222.0.20 "GET /compute/v2.1/servers/1f96263a-e229-447e-aa6b-dd9c2872c751" status: 200 len: 1245 microversion: 2.1 time: 0.137468 Jul 01 04:06:49.511867 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 133/257] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:06:49 2022] GET /compute/v2.1/servers/1f96263a-e229-447e-aa6b-dd9c2872c751 => generated 1245 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:06:49.576713 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-f4c123a3-9e51-412e-bf75-bfba85965c08 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:06:49.577370 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-f4c123a3-9e51-412e-bf75-bfba85965c08 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] [instance: b904f233-887c-4c96-a2d2-f7f415ad852f] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:06:49.596681 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-f4c123a3-9e51-412e-bf75-bfba85965c08 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:06:49.597139 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-f4c123a3-9e51-412e-bf75-bfba85965c08 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:06:49.603794 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-f4c123a3-9e51-412e-bf75-bfba85965c08 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:06:49.604505 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-f4c123a3-9e51-412e-bf75-bfba85965c08 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:06:49.907018 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-f4c123a3-9e51-412e-bf75-bfba85965c08 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:06:49.933436 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-f4c123a3-9e51-412e-bf75-bfba85965c08 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:06:49.940269 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-f4c123a3-9e51-412e-bf75-bfba85965c08 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:06:49.941540 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-f4c123a3-9e51-412e-bf75-bfba85965c08 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] 10.222.0.20 "GET /compute/v2.1/servers/b904f233-887c-4c96-a2d2-f7f415ad852f" status: 200 len: 1739 microversion: 2.20 time: 0.373589 Jul 01 04:06:49.954782 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 125/258] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Jul 1 04:06:49 2022] GET /compute/v2.1/servers/b904f233-887c-4c96-a2d2-f7f415ad852f => generated 1739 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 04:06:50.780834 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-6528d4d8-22aa-42bd-9730-977703431d45 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:06:50.780834 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-6528d4d8-22aa-42bd-9730-977703431d45 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] [instance: 1f96263a-e229-447e-aa6b-dd9c2872c751] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:06:50.780834 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-6528d4d8-22aa-42bd-9730-977703431d45 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:06:50.780834 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-6528d4d8-22aa-42bd-9730-977703431d45 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:06:50.784681 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-6528d4d8-22aa-42bd-9730-977703431d45 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:06:50.784681 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-6528d4d8-22aa-42bd-9730-977703431d45 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:06:50.934527 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-6528d4d8-22aa-42bd-9730-977703431d45 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8622ec5212c84d87b9b7c8f725012a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0143140d4f649478e36abcee284640c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:06:50.944702 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-6528d4d8-22aa-42bd-9730-977703431d45 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] 10.222.0.20 "GET /compute/v2.1/servers/1f96263a-e229-447e-aa6b-dd9c2872c751" status: 200 len: 1249 microversion: 2.1 time: 0.427424 Jul 01 04:06:50.955765 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 134/259] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:06:50 2022] GET /compute/v2.1/servers/1f96263a-e229-447e-aa6b-dd9c2872c751 => generated 1249 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:06:50.961181 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG dbcounter [-] [118711] Writing DB stats nova_cell0:SELECT=4 {{(pid=118711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:06:50.985290 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-4382c00a-13ed-47b2-ae04-d525d130ce27 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:06:50.987263 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-4382c00a-13ed-47b2-ae04-d525d130ce27 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] [instance: b904f233-887c-4c96-a2d2-f7f415ad852f] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:06:50.999930 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-4382c00a-13ed-47b2-ae04-d525d130ce27 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:06:51.000864 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-4382c00a-13ed-47b2-ae04-d525d130ce27 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:06:51.002479 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-4382c00a-13ed-47b2-ae04-d525d130ce27 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:06:51.003472 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-4382c00a-13ed-47b2-ae04-d525d130ce27 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:06:51.351311 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-4382c00a-13ed-47b2-ae04-d525d130ce27 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:06:51.373305 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-4382c00a-13ed-47b2-ae04-d525d130ce27 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:06:51.376849 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-4382c00a-13ed-47b2-ae04-d525d130ce27 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:06:51.379551 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-4382c00a-13ed-47b2-ae04-d525d130ce27 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] 10.222.0.20 "GET /compute/v2.1/servers/b904f233-887c-4c96-a2d2-f7f415ad852f" status: 200 len: 1739 microversion: 2.20 time: 0.421505 Jul 01 04:06:51.380693 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 126/260] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Jul 1 04:06:50 2022] GET /compute/v2.1/servers/b904f233-887c-4c96-a2d2-f7f415ad852f => generated 1739 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 04:06:51.994044 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-37eae8ea-c6d3-43c4-9f40-f0c0d53f7de7 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:06:51.998256 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-37eae8ea-c6d3-43c4-9f40-f0c0d53f7de7 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] [instance: 1f96263a-e229-447e-aa6b-dd9c2872c751] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:06:52.024516 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-37eae8ea-c6d3-43c4-9f40-f0c0d53f7de7 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:06:52.025784 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-37eae8ea-c6d3-43c4-9f40-f0c0d53f7de7 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:06:52.031869 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-37eae8ea-c6d3-43c4-9f40-f0c0d53f7de7 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:06:52.033047 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-37eae8ea-c6d3-43c4-9f40-f0c0d53f7de7 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:06:52.333805 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-37eae8ea-c6d3-43c4-9f40-f0c0d53f7de7 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8622ec5212c84d87b9b7c8f725012a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0143140d4f649478e36abcee284640c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:06:52.361576 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG dbcounter [-] [118712] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:06:52.374485 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-37eae8ea-c6d3-43c4-9f40-f0c0d53f7de7 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] 10.222.0.20 "GET /compute/v2.1/servers/1f96263a-e229-447e-aa6b-dd9c2872c751" status: 200 len: 1241 microversion: 2.1 time: 0.390133 Jul 01 04:06:52.376561 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 135/261] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:06:51 2022] GET /compute/v2.1/servers/1f96263a-e229-447e-aa6b-dd9c2872c751 => generated 1241 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:06:52.404872 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-515024b2-dfda-467a-9aee-ef10a0c01e36 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:06:52.409380 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-515024b2-dfda-467a-9aee-ef10a0c01e36 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] [instance: b904f233-887c-4c96-a2d2-f7f415ad852f] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:06:52.442994 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-515024b2-dfda-467a-9aee-ef10a0c01e36 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:06:52.444290 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-515024b2-dfda-467a-9aee-ef10a0c01e36 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:06:52.450490 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-515024b2-dfda-467a-9aee-ef10a0c01e36 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:06:52.454466 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-515024b2-dfda-467a-9aee-ef10a0c01e36 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:06:53.309743 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-515024b2-dfda-467a-9aee-ef10a0c01e36 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:06:53.326551 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-515024b2-dfda-467a-9aee-ef10a0c01e36 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:06:53.328152 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-515024b2-dfda-467a-9aee-ef10a0c01e36 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:06:53.337192 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-515024b2-dfda-467a-9aee-ef10a0c01e36 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] 10.222.0.20 "GET /compute/v2.1/servers/b904f233-887c-4c96-a2d2-f7f415ad852f" status: 200 len: 1739 microversion: 2.20 time: 0.941064 Jul 01 04:06:53.342274 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 127/262] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Jul 1 04:06:52 2022] GET /compute/v2.1/servers/b904f233-887c-4c96-a2d2-f7f415ad852f => generated 1739 bytes in 946 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 04:06:53.400916 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-a923f096-1081-4c5c-a8e5-1de3892acd1b tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:06:53.401696 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-a923f096-1081-4c5c-a8e5-1de3892acd1b tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] [instance: 1f96263a-e229-447e-aa6b-dd9c2872c751] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:06:53.432785 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-a923f096-1081-4c5c-a8e5-1de3892acd1b tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:06:53.433228 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-a923f096-1081-4c5c-a8e5-1de3892acd1b tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:06:53.448338 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-a923f096-1081-4c5c-a8e5-1de3892acd1b tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:06:53.449006 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-a923f096-1081-4c5c-a8e5-1de3892acd1b tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:06:53.573502 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-a923f096-1081-4c5c-a8e5-1de3892acd1b tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8622ec5212c84d87b9b7c8f725012a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0143140d4f649478e36abcee284640c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:06:53.598579 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-a923f096-1081-4c5c-a8e5-1de3892acd1b tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] 10.222.0.20 "GET /compute/v2.1/servers/1f96263a-e229-447e-aa6b-dd9c2872c751" status: 200 len: 1241 microversion: 2.1 time: 0.208928 Jul 01 04:06:53.600050 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 136/263] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:06:53 2022] GET /compute/v2.1/servers/1f96263a-e229-447e-aa6b-dd9c2872c751 => generated 1241 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:06:54.372231 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-99d3552d-f722-4c9f-b5e9-ae07fc1b3e1d tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:06:54.372231 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-99d3552d-f722-4c9f-b5e9-ae07fc1b3e1d tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] [instance: b904f233-887c-4c96-a2d2-f7f415ad852f] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:06:54.385030 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-99d3552d-f722-4c9f-b5e9-ae07fc1b3e1d tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:06:54.388463 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-99d3552d-f722-4c9f-b5e9-ae07fc1b3e1d tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:06:54.389542 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-99d3552d-f722-4c9f-b5e9-ae07fc1b3e1d tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:06:54.391284 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-99d3552d-f722-4c9f-b5e9-ae07fc1b3e1d tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:06:54.636521 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-28ddeb6e-c232-4f14-ae7a-a4056be983d2 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:06:54.652052 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-28ddeb6e-c232-4f14-ae7a-a4056be983d2 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] [instance: 1f96263a-e229-447e-aa6b-dd9c2872c751] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:06:54.752167 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-28ddeb6e-c232-4f14-ae7a-a4056be983d2 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:06:54.755630 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-28ddeb6e-c232-4f14-ae7a-a4056be983d2 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:06:54.761630 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-28ddeb6e-c232-4f14-ae7a-a4056be983d2 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:06:54.765618 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-28ddeb6e-c232-4f14-ae7a-a4056be983d2 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:06:55.041871 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-99d3552d-f722-4c9f-b5e9-ae07fc1b3e1d tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:06:55.086512 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-99d3552d-f722-4c9f-b5e9-ae07fc1b3e1d tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:06:55.092357 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-99d3552d-f722-4c9f-b5e9-ae07fc1b3e1d tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:06:55.107761 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-99d3552d-f722-4c9f-b5e9-ae07fc1b3e1d tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] 10.222.0.20 "GET /compute/v2.1/servers/b904f233-887c-4c96-a2d2-f7f415ad852f" status: 200 len: 1739 microversion: 2.20 time: 0.740432 Jul 01 04:06:55.119739 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 128/264] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Jul 1 04:06:54 2022] GET /compute/v2.1/servers/b904f233-887c-4c96-a2d2-f7f415ad852f => generated 1739 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 04:06:55.179945 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-28ddeb6e-c232-4f14-ae7a-a4056be983d2 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8622ec5212c84d87b9b7c8f725012a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0143140d4f649478e36abcee284640c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:06:55.220485 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-28ddeb6e-c232-4f14-ae7a-a4056be983d2 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] 10.222.0.20 "GET /compute/v2.1/servers/1f96263a-e229-447e-aa6b-dd9c2872c751" status: 200 len: 1297 microversion: 2.1 time: 0.592757 Jul 01 04:06:55.222058 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 137/265] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:06:54 2022] GET /compute/v2.1/servers/1f96263a-e229-447e-aa6b-dd9c2872c751 => generated 1297 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 04:06:56.152127 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-49b8f071-c781-450a-b8b1-a01b7770f7df tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:06:56.153759 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-49b8f071-c781-450a-b8b1-a01b7770f7df tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] [instance: b904f233-887c-4c96-a2d2-f7f415ad852f] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:06:56.202781 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-49b8f071-c781-450a-b8b1-a01b7770f7df tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:06:56.203568 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-49b8f071-c781-450a-b8b1-a01b7770f7df tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:06:56.204994 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-49b8f071-c781-450a-b8b1-a01b7770f7df tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:06:56.216931 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-49b8f071-c781-450a-b8b1-a01b7770f7df tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:06:56.256290 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-3e443cad-1e7b-4da5-9501-f52a943ac31c tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:06:56.257419 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-3e443cad-1e7b-4da5-9501-f52a943ac31c tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] [instance: 1f96263a-e229-447e-aa6b-dd9c2872c751] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:06:56.279001 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-3e443cad-1e7b-4da5-9501-f52a943ac31c tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:06:56.281793 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-3e443cad-1e7b-4da5-9501-f52a943ac31c tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:06:56.281793 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-3e443cad-1e7b-4da5-9501-f52a943ac31c tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:06:56.282168 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-3e443cad-1e7b-4da5-9501-f52a943ac31c tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:06:56.628886 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-3e443cad-1e7b-4da5-9501-f52a943ac31c tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8622ec5212c84d87b9b7c8f725012a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0143140d4f649478e36abcee284640c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:06:56.640877 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-3e443cad-1e7b-4da5-9501-f52a943ac31c tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] 10.222.0.20 "GET /compute/v2.1/servers/1f96263a-e229-447e-aa6b-dd9c2872c751" status: 200 len: 1297 microversion: 2.1 time: 0.391815 Jul 01 04:06:56.646006 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 138/266] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:06:56 2022] GET /compute/v2.1/servers/1f96263a-e229-447e-aa6b-dd9c2872c751 => generated 1297 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:06:56.700828 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-49b8f071-c781-450a-b8b1-a01b7770f7df tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:06:56.723442 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-49b8f071-c781-450a-b8b1-a01b7770f7df tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:06:56.731044 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-49b8f071-c781-450a-b8b1-a01b7770f7df tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:06:56.735494 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-49b8f071-c781-450a-b8b1-a01b7770f7df tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] 10.222.0.20 "GET /compute/v2.1/servers/b904f233-887c-4c96-a2d2-f7f415ad852f" status: 200 len: 1739 microversion: 2.20 time: 0.590966 Jul 01 04:06:56.747979 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 129/267] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Jul 1 04:06:56 2022] GET /compute/v2.1/servers/b904f233-887c-4c96-a2d2-f7f415ad852f => generated 1739 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 04:06:57.666097 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-0824a189-cb12-4e50-abb9-436527da3a89 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:06:57.666998 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-0824a189-cb12-4e50-abb9-436527da3a89 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] [instance: 1f96263a-e229-447e-aa6b-dd9c2872c751] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:06:57.678872 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-0824a189-cb12-4e50-abb9-436527da3a89 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:06:57.697338 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-0824a189-cb12-4e50-abb9-436527da3a89 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:06:57.703370 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-0824a189-cb12-4e50-abb9-436527da3a89 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:06:57.703370 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-0824a189-cb12-4e50-abb9-436527da3a89 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:06:57.760270 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-01bc34ba-1ba1-46ad-b11c-d7877ef034ad tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:06:57.768393 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-01bc34ba-1ba1-46ad-b11c-d7877ef034ad tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] [instance: b904f233-887c-4c96-a2d2-f7f415ad852f] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:06:57.795522 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-01bc34ba-1ba1-46ad-b11c-d7877ef034ad tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:06:57.796342 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-01bc34ba-1ba1-46ad-b11c-d7877ef034ad tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:06:57.797740 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-01bc34ba-1ba1-46ad-b11c-d7877ef034ad tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:06:57.798534 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-01bc34ba-1ba1-46ad-b11c-d7877ef034ad tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:06:57.844332 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG dbcounter [-] [118712] Writing DB stats nova_cell0:SELECT=2 {{(pid=118712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:06:57.920310 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-0824a189-cb12-4e50-abb9-436527da3a89 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8622ec5212c84d87b9b7c8f725012a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0143140d4f649478e36abcee284640c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:06:57.936824 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-0824a189-cb12-4e50-abb9-436527da3a89 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] 10.222.0.20 "GET /compute/v2.1/servers/1f96263a-e229-447e-aa6b-dd9c2872c751" status: 200 len: 1305 microversion: 2.1 time: 0.276860 Jul 01 04:06:57.948662 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 139/268] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:06:57 2022] GET /compute/v2.1/servers/1f96263a-e229-447e-aa6b-dd9c2872c751 => generated 1305 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:06:58.116795 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-01bc34ba-1ba1-46ad-b11c-d7877ef034ad tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:06:58.141525 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-01bc34ba-1ba1-46ad-b11c-d7877ef034ad tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:06:58.144754 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-01bc34ba-1ba1-46ad-b11c-d7877ef034ad tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:06:58.147432 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-01bc34ba-1ba1-46ad-b11c-d7877ef034ad tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] 10.222.0.20 "GET /compute/v2.1/servers/b904f233-887c-4c96-a2d2-f7f415ad852f" status: 200 len: 1739 microversion: 2.20 time: 0.396057 Jul 01 04:06:58.149277 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 130/269] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Jul 1 04:06:57 2022] GET /compute/v2.1/servers/b904f233-887c-4c96-a2d2-f7f415ad852f => generated 1739 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 04:06:58.957424 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-5e3e6081-0bd0-4e9c-8c44-2b358dcb0eef tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:06:58.958437 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-5e3e6081-0bd0-4e9c-8c44-2b358dcb0eef tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] [instance: 1f96263a-e229-447e-aa6b-dd9c2872c751] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:06:58.978332 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-5e3e6081-0bd0-4e9c-8c44-2b358dcb0eef tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:06:58.978332 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-5e3e6081-0bd0-4e9c-8c44-2b358dcb0eef tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:06:58.978332 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-5e3e6081-0bd0-4e9c-8c44-2b358dcb0eef tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:06:58.978332 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-5e3e6081-0bd0-4e9c-8c44-2b358dcb0eef tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:06:59.067168 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-5e3e6081-0bd0-4e9c-8c44-2b358dcb0eef tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8622ec5212c84d87b9b7c8f725012a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0143140d4f649478e36abcee284640c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:06:59.077699 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-5e3e6081-0bd0-4e9c-8c44-2b358dcb0eef tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] 10.222.0.20 "GET /compute/v2.1/servers/1f96263a-e229-447e-aa6b-dd9c2872c751" status: 200 len: 1305 microversion: 2.1 time: 0.125607 Jul 01 04:06:59.078288 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 140/270] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:06:58 2022] GET /compute/v2.1/servers/1f96263a-e229-447e-aa6b-dd9c2872c751 => generated 1305 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 04:06:59.176298 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-e860f7d2-c3f4-4211-bd32-881978648529 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:06:59.177025 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-e860f7d2-c3f4-4211-bd32-881978648529 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] [instance: b904f233-887c-4c96-a2d2-f7f415ad852f] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:06:59.185139 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-e860f7d2-c3f4-4211-bd32-881978648529 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:06:59.185599 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-e860f7d2-c3f4-4211-bd32-881978648529 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:06:59.186419 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-e860f7d2-c3f4-4211-bd32-881978648529 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:06:59.186888 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-e860f7d2-c3f4-4211-bd32-881978648529 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:06:59.341710 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-e860f7d2-c3f4-4211-bd32-881978648529 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:06:59.350921 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-e860f7d2-c3f4-4211-bd32-881978648529 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:06:59.352651 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-e860f7d2-c3f4-4211-bd32-881978648529 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:06:59.353894 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-e860f7d2-c3f4-4211-bd32-881978648529 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] 10.222.0.20 "GET /compute/v2.1/servers/b904f233-887c-4c96-a2d2-f7f415ad852f" status: 200 len: 1739 microversion: 2.20 time: 0.181966 Jul 01 04:06:59.354482 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 131/271] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Jul 1 04:06:59 2022] GET /compute/v2.1/servers/b904f233-887c-4c96-a2d2-f7f415ad852f => generated 1739 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 04:07:00.097957 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-83e673b0-f748-4eb3-9b10-702bec150f3f tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:07:00.102717 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-83e673b0-f748-4eb3-9b10-702bec150f3f tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] [instance: 1f96263a-e229-447e-aa6b-dd9c2872c751] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:07:00.117148 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG dbcounter [-] [118712] Writing DB stats nova_cell0:SELECT=10 {{(pid=118712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:07:00.119351 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-83e673b0-f748-4eb3-9b10-702bec150f3f tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:07:00.120913 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-83e673b0-f748-4eb3-9b10-702bec150f3f tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:07:00.122216 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-83e673b0-f748-4eb3-9b10-702bec150f3f tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:07:00.122991 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-83e673b0-f748-4eb3-9b10-702bec150f3f tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:07:00.304852 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-83e673b0-f748-4eb3-9b10-702bec150f3f tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8622ec5212c84d87b9b7c8f725012a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0143140d4f649478e36abcee284640c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:07:00.318382 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-83e673b0-f748-4eb3-9b10-702bec150f3f tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] 10.222.0.20 "GET /compute/v2.1/servers/1f96263a-e229-447e-aa6b-dd9c2872c751" status: 200 len: 1315 microversion: 2.1 time: 0.225761 Jul 01 04:07:00.328540 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 141/272] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:07:00 2022] GET /compute/v2.1/servers/1f96263a-e229-447e-aa6b-dd9c2872c751 => generated 1315 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 04:07:00.373537 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-bf37744b-cc44-4dc9-9e86-dadeb2cb0aaa tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:07:00.374894 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-bf37744b-cc44-4dc9-9e86-dadeb2cb0aaa tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] [instance: b904f233-887c-4c96-a2d2-f7f415ad852f] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:07:00.383333 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-bf37744b-cc44-4dc9-9e86-dadeb2cb0aaa tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:07:00.388057 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-bf37744b-cc44-4dc9-9e86-dadeb2cb0aaa tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:07:00.389873 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-bf37744b-cc44-4dc9-9e86-dadeb2cb0aaa tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:07:00.390554 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-bf37744b-cc44-4dc9-9e86-dadeb2cb0aaa tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:07:00.657985 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-bf37744b-cc44-4dc9-9e86-dadeb2cb0aaa tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:07:00.671831 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-bf37744b-cc44-4dc9-9e86-dadeb2cb0aaa tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:07:00.675508 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-bf37744b-cc44-4dc9-9e86-dadeb2cb0aaa tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:07:00.678247 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-bf37744b-cc44-4dc9-9e86-dadeb2cb0aaa tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] 10.222.0.20 "GET /compute/v2.1/servers/b904f233-887c-4c96-a2d2-f7f415ad852f" status: 200 len: 1739 microversion: 2.20 time: 0.308706 Jul 01 04:07:00.679080 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 132/273] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Jul 1 04:07:00 2022] GET /compute/v2.1/servers/b904f233-887c-4c96-a2d2-f7f415ad852f => generated 1739 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 04:07:01.337007 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-dbcc2426-e9dd-44ed-8801-5dac112d6f37 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:07:01.338304 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-dbcc2426-e9dd-44ed-8801-5dac112d6f37 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] [instance: 1f96263a-e229-447e-aa6b-dd9c2872c751] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:07:01.345482 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-dbcc2426-e9dd-44ed-8801-5dac112d6f37 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:07:01.346369 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-dbcc2426-e9dd-44ed-8801-5dac112d6f37 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:07:01.347438 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-dbcc2426-e9dd-44ed-8801-5dac112d6f37 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:07:01.348163 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-dbcc2426-e9dd-44ed-8801-5dac112d6f37 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:07:01.466042 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-dbcc2426-e9dd-44ed-8801-5dac112d6f37 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8622ec5212c84d87b9b7c8f725012a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0143140d4f649478e36abcee284640c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:07:01.479170 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-dbcc2426-e9dd-44ed-8801-5dac112d6f37 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] 10.222.0.20 "GET /compute/v2.1/servers/1f96263a-e229-447e-aa6b-dd9c2872c751" status: 200 len: 1303 microversion: 2.1 time: 0.146829 Jul 01 04:07:01.480374 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 142/274] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:07:01 2022] GET /compute/v2.1/servers/1f96263a-e229-447e-aa6b-dd9c2872c751 => generated 1303 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 04:07:01.715068 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-74a6787f-044f-4780-88f8-08dc4e594eaa tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:07:01.716969 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-74a6787f-044f-4780-88f8-08dc4e594eaa tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] [instance: b904f233-887c-4c96-a2d2-f7f415ad852f] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:07:01.725466 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-74a6787f-044f-4780-88f8-08dc4e594eaa tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:07:01.726794 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-74a6787f-044f-4780-88f8-08dc4e594eaa tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:07:01.728194 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-74a6787f-044f-4780-88f8-08dc4e594eaa tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:07:01.728816 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-74a6787f-044f-4780-88f8-08dc4e594eaa tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:07:01.963798 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-74a6787f-044f-4780-88f8-08dc4e594eaa tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:07:01.977517 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-74a6787f-044f-4780-88f8-08dc4e594eaa tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:07:01.983880 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-74a6787f-044f-4780-88f8-08dc4e594eaa tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:07:01.985310 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-74a6787f-044f-4780-88f8-08dc4e594eaa tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] 10.222.0.20 "GET /compute/v2.1/servers/b904f233-887c-4c96-a2d2-f7f415ad852f" status: 200 len: 1739 microversion: 2.20 time: 0.285726 Jul 01 04:07:01.986179 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 133/275] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Jul 1 04:07:01 2022] GET /compute/v2.1/servers/b904f233-887c-4c96-a2d2-f7f415ad852f => generated 1739 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 04:07:02.516974 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-d733f29b-2cdb-4bfe-ba6e-1bb7c7c17ab0 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:07:02.520102 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-d733f29b-2cdb-4bfe-ba6e-1bb7c7c17ab0 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] [instance: 1f96263a-e229-447e-aa6b-dd9c2872c751] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:07:02.532998 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-d733f29b-2cdb-4bfe-ba6e-1bb7c7c17ab0 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:07:02.533754 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-d733f29b-2cdb-4bfe-ba6e-1bb7c7c17ab0 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:07:02.535016 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-d733f29b-2cdb-4bfe-ba6e-1bb7c7c17ab0 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:07:02.535683 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-d733f29b-2cdb-4bfe-ba6e-1bb7c7c17ab0 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:07:03.010913 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-682bb8b4-f340-45da-b142-90a117a9dc27 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:07:03.022135 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-682bb8b4-f340-45da-b142-90a117a9dc27 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] [instance: b904f233-887c-4c96-a2d2-f7f415ad852f] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:07:03.035516 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-682bb8b4-f340-45da-b142-90a117a9dc27 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:07:03.036250 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-682bb8b4-f340-45da-b142-90a117a9dc27 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:07:03.038257 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-682bb8b4-f340-45da-b142-90a117a9dc27 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:07:03.039071 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-682bb8b4-f340-45da-b142-90a117a9dc27 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:07:03.226247 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-682bb8b4-f340-45da-b142-90a117a9dc27 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:07:03.235719 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-682bb8b4-f340-45da-b142-90a117a9dc27 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:07:03.238431 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-682bb8b4-f340-45da-b142-90a117a9dc27 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:07:03.240036 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-682bb8b4-f340-45da-b142-90a117a9dc27 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] 10.222.0.20 "GET /compute/v2.1/servers/b904f233-887c-4c96-a2d2-f7f415ad852f" status: 200 len: 1739 microversion: 2.20 time: 0.238681 Jul 01 04:07:03.240773 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 134/276] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Jul 1 04:07:02 2022] GET /compute/v2.1/servers/b904f233-887c-4c96-a2d2-f7f415ad852f => generated 1739 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 04:07:03.289514 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-d733f29b-2cdb-4bfe-ba6e-1bb7c7c17ab0 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8622ec5212c84d87b9b7c8f725012a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0143140d4f649478e36abcee284640c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:07:03.300906 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-d733f29b-2cdb-4bfe-ba6e-1bb7c7c17ab0 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] 10.222.0.20 "GET /compute/v2.1/servers/1f96263a-e229-447e-aa6b-dd9c2872c751" status: 200 len: 1371 microversion: 2.1 time: 0.800298 Jul 01 04:07:03.302008 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 143/277] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:07:02 2022] GET /compute/v2.1/servers/1f96263a-e229-447e-aa6b-dd9c2872c751 => generated 1371 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:07:04.260505 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-36581f7f-fe85-4aed-bfca-423b714f4474 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:07:04.261385 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-36581f7f-fe85-4aed-bfca-423b714f4474 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] [instance: b904f233-887c-4c96-a2d2-f7f415ad852f] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:07:04.276408 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-36581f7f-fe85-4aed-bfca-423b714f4474 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:07:04.276861 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-36581f7f-fe85-4aed-bfca-423b714f4474 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:07:04.277734 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-36581f7f-fe85-4aed-bfca-423b714f4474 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:07:04.278131 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-36581f7f-fe85-4aed-bfca-423b714f4474 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:07:04.327330 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-9fcb32f2-32b1-459b-b67b-ece027444c70 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:07:04.329384 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-9fcb32f2-32b1-459b-b67b-ece027444c70 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] [instance: 1f96263a-e229-447e-aa6b-dd9c2872c751] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:07:04.384711 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-9fcb32f2-32b1-459b-b67b-ece027444c70 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:07:04.390202 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-9fcb32f2-32b1-459b-b67b-ece027444c70 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:07:04.391582 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-9fcb32f2-32b1-459b-b67b-ece027444c70 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:07:04.395038 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-9fcb32f2-32b1-459b-b67b-ece027444c70 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:07:04.551695 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-36581f7f-fe85-4aed-bfca-423b714f4474 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:07:04.560458 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-36581f7f-fe85-4aed-bfca-423b714f4474 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:07:04.562033 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-36581f7f-fe85-4aed-bfca-423b714f4474 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:07:04.566360 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-36581f7f-fe85-4aed-bfca-423b714f4474 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] 10.222.0.20 "GET /compute/v2.1/servers/b904f233-887c-4c96-a2d2-f7f415ad852f" status: 200 len: 1739 microversion: 2.20 time: 0.309959 Jul 01 04:07:04.569232 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 135/278] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Jul 1 04:07:04 2022] GET /compute/v2.1/servers/b904f233-887c-4c96-a2d2-f7f415ad852f => generated 1739 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 01 04:07:04.738060 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [req-b707ff18-4882-4c76-9fcc-afd684b6e000 req-95e18888-1ac3-4967-bf5a-55d62a8b890a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1f96263a-e229-447e-aa6b-dd9c2872c751", "tag": "562a39f3-c337-47af-9f9d-fabcdc36a52b"}]} {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 04:07:04.747169 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [req-b707ff18-4882-4c76-9fcc-afd684b6e000 req-95e18888-1ac3-4967-bf5a-55d62a8b890a service nova] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:07:04.747992 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [req-b707ff18-4882-4c76-9fcc-afd684b6e000 req-95e18888-1ac3-4967-bf5a-55d62a8b890a service nova] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:07:04.774292 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.compute.server_external_events [req-b707ff18-4882-4c76-9fcc-afd684b6e000 req-95e18888-1ac3-4967-bf5a-55d62a8b890a service nova] Creating event network-changed:562a39f3-c337-47af-9f9d-fabcdc36a52b for instance 1f96263a-e229-447e-aa6b-dd9c2872c751 on hv-cinder-84684 Jul 01 04:07:04.786260 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [req-b707ff18-4882-4c76-9fcc-afd684b6e000 req-95e18888-1ac3-4967-bf5a-55d62a8b890a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051064 Jul 01 04:07:04.787888 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 136/279] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Jul 1 04:07:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 04:07:04.948646 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-9fcb32f2-32b1-459b-b67b-ece027444c70 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8622ec5212c84d87b9b7c8f725012a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0143140d4f649478e36abcee284640c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:07:04.971262 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-9fcb32f2-32b1-459b-b67b-ece027444c70 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] 10.222.0.20 "GET /compute/v2.1/servers/1f96263a-e229-447e-aa6b-dd9c2872c751" status: 200 len: 1371 microversion: 2.1 time: 0.653209 Jul 01 04:07:04.972750 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 144/280] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:07:04 2022] GET /compute/v2.1/servers/1f96263a-e229-447e-aa6b-dd9c2872c751 => generated 1371 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:07:05.597084 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-ba9e343c-f32b-41a5-979f-704ee60198c7 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:07:05.597949 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-ba9e343c-f32b-41a5-979f-704ee60198c7 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] [instance: b904f233-887c-4c96-a2d2-f7f415ad852f] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:07:05.606418 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-ba9e343c-f32b-41a5-979f-704ee60198c7 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:07:05.607163 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-ba9e343c-f32b-41a5-979f-704ee60198c7 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:07:05.610225 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-ba9e343c-f32b-41a5-979f-704ee60198c7 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:07:05.611594 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-ba9e343c-f32b-41a5-979f-704ee60198c7 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:07:05.871874 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-ba9e343c-f32b-41a5-979f-704ee60198c7 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:07:05.890410 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-ba9e343c-f32b-41a5-979f-704ee60198c7 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:07:05.894503 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-ba9e343c-f32b-41a5-979f-704ee60198c7 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:07:05.897362 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-ba9e343c-f32b-41a5-979f-704ee60198c7 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] 10.222.0.20 "GET /compute/v2.1/servers/b904f233-887c-4c96-a2d2-f7f415ad852f" status: 200 len: 1739 microversion: 2.20 time: 0.304541 Jul 01 04:07:05.911892 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 137/281] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Jul 1 04:07:05 2022] GET /compute/v2.1/servers/b904f233-887c-4c96-a2d2-f7f415ad852f => generated 1739 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 01 04:07:05.992279 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-8a979a88-c6ca-493e-9949-29c3cd9fa354 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:07:05.993530 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-8a979a88-c6ca-493e-9949-29c3cd9fa354 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] [instance: 1f96263a-e229-447e-aa6b-dd9c2872c751] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:07:06.001724 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-8a979a88-c6ca-493e-9949-29c3cd9fa354 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:07:06.005065 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-8a979a88-c6ca-493e-9949-29c3cd9fa354 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:07:06.006311 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-8a979a88-c6ca-493e-9949-29c3cd9fa354 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:07:06.006750 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-8a979a88-c6ca-493e-9949-29c3cd9fa354 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:07:06.323627 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-8a979a88-c6ca-493e-9949-29c3cd9fa354 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8622ec5212c84d87b9b7c8f725012a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0143140d4f649478e36abcee284640c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:07:06.337529 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-8a979a88-c6ca-493e-9949-29c3cd9fa354 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] 10.222.0.20 "GET /compute/v2.1/servers/1f96263a-e229-447e-aa6b-dd9c2872c751" status: 200 len: 1371 microversion: 2.1 time: 0.349775 Jul 01 04:07:06.344810 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 145/282] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:07:05 2022] GET /compute/v2.1/servers/1f96263a-e229-447e-aa6b-dd9c2872c751 => generated 1371 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:07:06.930140 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-e343f682-2524-4eb3-a4ed-f16542f5a29f tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:07:06.932401 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-e343f682-2524-4eb3-a4ed-f16542f5a29f tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] [instance: b904f233-887c-4c96-a2d2-f7f415ad852f] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:07:06.957564 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-e343f682-2524-4eb3-a4ed-f16542f5a29f tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:07:06.960415 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-e343f682-2524-4eb3-a4ed-f16542f5a29f tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:07:06.961824 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-e343f682-2524-4eb3-a4ed-f16542f5a29f tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:07:06.962679 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-e343f682-2524-4eb3-a4ed-f16542f5a29f tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:07:07.313054 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-e343f682-2524-4eb3-a4ed-f16542f5a29f tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:07:07.328646 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-e343f682-2524-4eb3-a4ed-f16542f5a29f tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:07:07.333293 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-e343f682-2524-4eb3-a4ed-f16542f5a29f tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:07:07.347949 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-e343f682-2524-4eb3-a4ed-f16542f5a29f tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] 10.222.0.20 "GET /compute/v2.1/servers/b904f233-887c-4c96-a2d2-f7f415ad852f" status: 200 len: 1721 microversion: 2.20 time: 0.412391 Jul 01 04:07:07.349188 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 138/283] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Jul 1 04:07:06 2022] GET /compute/v2.1/servers/b904f233-887c-4c96-a2d2-f7f415ad852f => generated 1721 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 04:07:07.377009 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-b5cac962-4843-4c30-8433-49bcff7d584c tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:07:07.377653 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-b5cac962-4843-4c30-8433-49bcff7d584c tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] [instance: 1f96263a-e229-447e-aa6b-dd9c2872c751] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:07:07.400952 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-b5cac962-4843-4c30-8433-49bcff7d584c tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:07:07.403970 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-b5cac962-4843-4c30-8433-49bcff7d584c tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:07:07.407086 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-b5cac962-4843-4c30-8433-49bcff7d584c tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:07:07.407783 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-b5cac962-4843-4c30-8433-49bcff7d584c tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:07:07.645879 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-adefc5b3-7def-4257-a9df-1b5aefcf3900 tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1757565633", "imageRef": "66f9f4ba-339c-4967-8857-d65299a66629", "flavorRef": "452", "networks": [{"uuid": "e654d240-5e2e-4d49-8404-34c396ff0d3d"}]}} {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 04:07:07.754804 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.network.neutron [None req-adefc5b3-7def-4257-a9df-1b5aefcf3900 tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] validate_networks() for [('e654d240-5e2e-4d49-8404-34c396ff0d3d', None, None, None, None, None)] {{(pid=118711) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 01 04:07:07.799716 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-b5cac962-4843-4c30-8433-49bcff7d584c tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8622ec5212c84d87b9b7c8f725012a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0143140d4f649478e36abcee284640c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:07:07.822149 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-b5cac962-4843-4c30-8433-49bcff7d584c tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] 10.222.0.20 "GET /compute/v2.1/servers/1f96263a-e229-447e-aa6b-dd9c2872c751" status: 200 len: 1371 microversion: 2.1 time: 0.456378 Jul 01 04:07:07.823516 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 146/284] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:07:07 2022] GET /compute/v2.1/servers/1f96263a-e229-447e-aa6b-dd9c2872c751 => generated 1371 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:07:08.329137 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.virt.hardware [None req-adefc5b3-7def-4257-a9df-1b5aefcf3900 tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Flavor limits 0:0:0 {{(pid=118711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 01 04:07:08.330114 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.virt.hardware [None req-adefc5b3-7def-4257-a9df-1b5aefcf3900 tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Image limits 0:0:0 {{(pid=118711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 01 04:07:08.330527 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.virt.hardware [None req-adefc5b3-7def-4257-a9df-1b5aefcf3900 tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Flavor pref 0:0:0 {{(pid=118711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 01 04:07:08.331048 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.virt.hardware [None req-adefc5b3-7def-4257-a9df-1b5aefcf3900 tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Image pref 0:0:0 {{(pid=118711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 01 04:07:08.331594 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.virt.hardware [None req-adefc5b3-7def-4257-a9df-1b5aefcf3900 tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 01 04:07:08.344232 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-adefc5b3-7def-4257-a9df-1b5aefcf3900 tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:07:08.344838 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-adefc5b3-7def-4257-a9df-1b5aefcf3900 tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:07:08.345695 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-adefc5b3-7def-4257-a9df-1b5aefcf3900 tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:07:08.346208 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-adefc5b3-7def-4257-a9df-1b5aefcf3900 tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:07:08.367970 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.quota [None req-adefc5b3-7def-4257-a9df-1b5aefcf3900 tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Getting quotas for project e87ca5d9f50847d6ab501ca3a51ab37c. Resources: {'ram', 'cores', 'instances'} {{(pid=118711) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 04:07:08.371766 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-5e25575f-4070-48b2-a359-20ad350fec22 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:07:08.372880 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-5e25575f-4070-48b2-a359-20ad350fec22 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] [instance: b904f233-887c-4c96-a2d2-f7f415ad852f] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:07:08.376780 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.quota [None req-adefc5b3-7def-4257-a9df-1b5aefcf3900 tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Getting quotas for user 021817b0eef94fc2a19d90c511ec9298 and project e87ca5d9f50847d6ab501ca3a51ab37c. Resources: {'ram', 'cores', 'instances'} {{(pid=118711) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 04:07:08.381280 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-5e25575f-4070-48b2-a359-20ad350fec22 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:07:08.387859 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-5e25575f-4070-48b2-a359-20ad350fec22 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:07:08.388754 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-5e25575f-4070-48b2-a359-20ad350fec22 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:07:08.389207 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-5e25575f-4070-48b2-a359-20ad350fec22 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:07:08.400117 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-adefc5b3-7def-4257-a9df-1b5aefcf3900 tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Going to run 1 instances... {{(pid=118711) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 01 04:07:08.404819 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-adefc5b3-7def-4257-a9df-1b5aefcf3900 tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] [instance: 16079191-5fa2-4add-8134-bf7d18446a6a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='66f9f4ba-339c-4967-8857-d65299a66629',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118711) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 01 04:07:08.593825 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-5e25575f-4070-48b2-a359-20ad350fec22 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:07:08.604196 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-5e25575f-4070-48b2-a359-20ad350fec22 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:07:08.605741 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-5e25575f-4070-48b2-a359-20ad350fec22 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:07:08.606943 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-5e25575f-4070-48b2-a359-20ad350fec22 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] 10.222.0.20 "GET /compute/v2.1/servers/b904f233-887c-4c96-a2d2-f7f415ad852f" status: 200 len: 1721 microversion: 2.20 time: 0.242981 Jul 01 04:07:08.607587 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 147/285] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Jul 1 04:07:08 2022] GET /compute/v2.1/servers/b904f233-887c-4c96-a2d2-f7f415ad852f => generated 1721 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 01 04:07:08.857425 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-17502d47-488d-4c7e-ad1e-23d25194cb93 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:07:08.858588 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-17502d47-488d-4c7e-ad1e-23d25194cb93 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] [instance: 1f96263a-e229-447e-aa6b-dd9c2872c751] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:07:08.882708 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-17502d47-488d-4c7e-ad1e-23d25194cb93 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:07:08.883583 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-17502d47-488d-4c7e-ad1e-23d25194cb93 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:07:08.893739 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-17502d47-488d-4c7e-ad1e-23d25194cb93 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:07:08.894994 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-17502d47-488d-4c7e-ad1e-23d25194cb93 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:07:09.065874 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-adefc5b3-7def-4257-a9df-1b5aefcf3900 tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.423504 Jul 01 04:07:09.077565 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 139/286] 10.222.0.20 () {60 vars in 1146 bytes} [Fri Jul 1 04:07:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 1437 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 01 04:07:09.131181 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [req-3051c69e-6ca6-4d11-a8b5-a6352d886b8c req-e65127f8-97e1-41b9-ad9e-7a1b9e341883 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b904f233-887c-4c96-a2d2-f7f415ad852f", "name": "network-vif-unplugged", "status": "completed", "tag": "b1d88871-2b18-4397-8234-7831054c30f0"}]} {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 04:07:09.198553 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [req-3051c69e-6ca6-4d11-a8b5-a6352d886b8c req-e65127f8-97e1-41b9-ad9e-7a1b9e341883 service nova] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:07:09.203407 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [req-3051c69e-6ca6-4d11-a8b5-a6352d886b8c req-e65127f8-97e1-41b9-ad9e-7a1b9e341883 service nova] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:07:09.233325 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.compute.server_external_events [req-3051c69e-6ca6-4d11-a8b5-a6352d886b8c req-e65127f8-97e1-41b9-ad9e-7a1b9e341883 service nova] Creating event network-vif-unplugged:b1d88871-2b18-4397-8234-7831054c30f0 for instance b904f233-887c-4c96-a2d2-f7f415ad852f on hv-cinder-84684 Jul 01 04:07:09.251934 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [req-3051c69e-6ca6-4d11-a8b5-a6352d886b8c req-e65127f8-97e1-41b9-ad9e-7a1b9e341883 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.172546 Jul 01 04:07:09.259384 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 140/287] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Jul 1 04:07:09 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 04:07:09.270004 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-7b93e75f-1de7-44da-855d-5d5bb9372d9b tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:07:09.271022 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-7b93e75f-1de7-44da-855d-5d5bb9372d9b tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] [instance: 16079191-5fa2-4add-8134-bf7d18446a6a] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:07:09.363139 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-17502d47-488d-4c7e-ad1e-23d25194cb93 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8622ec5212c84d87b9b7c8f725012a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0143140d4f649478e36abcee284640c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:07:09.369028 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-17502d47-488d-4c7e-ad1e-23d25194cb93 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] 10.222.0.20 "GET /compute/v2.1/servers/1f96263a-e229-447e-aa6b-dd9c2872c751" status: 200 len: 1371 microversion: 2.1 time: 0.519511 Jul 01 04:07:09.380611 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 148/288] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:07:08 2022] GET /compute/v2.1/servers/1f96263a-e229-447e-aa6b-dd9c2872c751 => generated 1371 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:07:09.392295 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-7b93e75f-1de7-44da-855d-5d5bb9372d9b tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021817b0eef94fc2a19d90c511ec9298', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87ca5d9f50847d6ab501ca3a51ab37c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:07:09.415136 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-7b93e75f-1de7-44da-855d-5d5bb9372d9b tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] 10.222.0.20 "GET /compute/v2.1/servers/16079191-5fa2-4add-8134-bf7d18446a6a" status: 200 len: 1219 microversion: 2.1 time: 0.154030 Jul 01 04:07:09.415906 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 141/289] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:07:09 2022] GET /compute/v2.1/servers/16079191-5fa2-4add-8134-bf7d18446a6a => generated 1219 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:07:09.626686 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-7dde0ac2-1acb-44bd-966a-b5a33cecf879 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:07:09.628481 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-7dde0ac2-1acb-44bd-966a-b5a33cecf879 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] [instance: b904f233-887c-4c96-a2d2-f7f415ad852f] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:07:09.641478 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-7dde0ac2-1acb-44bd-966a-b5a33cecf879 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:07:09.642790 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-7dde0ac2-1acb-44bd-966a-b5a33cecf879 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:07:09.644891 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-7dde0ac2-1acb-44bd-966a-b5a33cecf879 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:07:09.646810 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-7dde0ac2-1acb-44bd-966a-b5a33cecf879 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:07:09.843337 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-7dde0ac2-1acb-44bd-966a-b5a33cecf879 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:07:09.852293 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-7dde0ac2-1acb-44bd-966a-b5a33cecf879 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:07:09.853819 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-7dde0ac2-1acb-44bd-966a-b5a33cecf879 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:07:09.855069 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-7dde0ac2-1acb-44bd-966a-b5a33cecf879 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] 10.222.0.20 "GET /compute/v2.1/servers/b904f233-887c-4c96-a2d2-f7f415ad852f" status: 200 len: 1721 microversion: 2.20 time: 0.232789 Jul 01 04:07:09.856318 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 149/290] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Jul 1 04:07:09 2022] GET /compute/v2.1/servers/b904f233-887c-4c96-a2d2-f7f415ad852f => generated 1721 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 04:07:10.324133 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-23c21b8f-5594-4ead-886d-67902bc29d29 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Action: 'create', calling method: .version_select at 0x7f99a0a48310>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-466542453", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOCz9jQBwqAovdOSimNMo84ghMBpIJUh5Jlrmz9VsX5iOCx/rEJh7lJGCwkGslE56lQmzZ3aACOrOc+l6HrcLTZekV+3NtadFqs9pkbp9boZSd/HwOIPeS62BdTsVE3iZA=="}} {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 04:07:10.351729 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.quota [None req-23c21b8f-5594-4ead-886d-67902bc29d29 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Getting quotas for project 2940ca71c4b24b5facc194b61d748a11. Resources: {'key_pairs'} {{(pid=118711) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 04:07:10.360834 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.quota [None req-23c21b8f-5594-4ead-886d-67902bc29d29 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Getting quotas for user abc2e04754884398afc999d423e2a711 and project 2940ca71c4b24b5facc194b61d748a11. Resources: {'key_pairs'} {{(pid=118711) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 04:07:10.389050 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-c68174e6-5469-439f-86c8-5cbf3a0fb494 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:07:10.389906 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-c68174e6-5469-439f-86c8-5cbf3a0fb494 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] [instance: 1f96263a-e229-447e-aa6b-dd9c2872c751] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:07:10.397456 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-c68174e6-5469-439f-86c8-5cbf3a0fb494 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:07:10.398371 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-c68174e6-5469-439f-86c8-5cbf3a0fb494 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:07:10.399328 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-c68174e6-5469-439f-86c8-5cbf3a0fb494 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:07:10.399861 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-c68174e6-5469-439f-86c8-5cbf3a0fb494 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:07:10.478202 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-23c21b8f-5594-4ead-886d-67902bc29d29 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.161271 Jul 01 04:07:10.479489 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 142/291] 10.222.0.20 () {60 vars in 1158 bytes} [Fri Jul 1 04:07:10 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 04:07:10.487852 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-55a62dbf-3758-4734-8f7d-f133f58a9b12 tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:07:10.487852 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-55a62dbf-3758-4734-8f7d-f133f58a9b12 tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] [instance: 16079191-5fa2-4add-8134-bf7d18446a6a] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:07:10.570336 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-55a62dbf-3758-4734-8f7d-f133f58a9b12 tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021817b0eef94fc2a19d90c511ec9298', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87ca5d9f50847d6ab501ca3a51ab37c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:07:10.579580 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-55a62dbf-3758-4734-8f7d-f133f58a9b12 tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] 10.222.0.20 "GET /compute/v2.1/servers/16079191-5fa2-4add-8134-bf7d18446a6a" status: 200 len: 1219 microversion: 2.1 time: 0.098493 Jul 01 04:07:10.580852 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 143/292] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:07:10 2022] GET /compute/v2.1/servers/16079191-5fa2-4add-8134-bf7d18446a6a => generated 1219 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:07:10.642401 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-c68174e6-5469-439f-86c8-5cbf3a0fb494 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8622ec5212c84d87b9b7c8f725012a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0143140d4f649478e36abcee284640c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:07:10.660708 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-c68174e6-5469-439f-86c8-5cbf3a0fb494 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] 10.222.0.20 "GET /compute/v2.1/servers/1f96263a-e229-447e-aa6b-dd9c2872c751" status: 200 len: 1371 microversion: 2.1 time: 0.274820 Jul 01 04:07:10.674030 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 150/293] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:07:10 2022] GET /compute/v2.1/servers/1f96263a-e229-447e-aa6b-dd9c2872c751 => generated 1371 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 04:07:10.705465 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-839cc5aa-e946-4d0d-91a6-47ea4f392e91 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1029751625", "imageRef": "e1924e42-895f-4317-9e5b-596f5a2d3d23", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-466542453", "networks": [{"uuid": "11532706-97ea-4f88-ab9d-7fef5939ae90"}]}} {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 04:07:10.804048 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.network.neutron [None req-839cc5aa-e946-4d0d-91a6-47ea4f392e91 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] validate_networks() for [('11532706-97ea-4f88-ab9d-7fef5939ae90', None, None, None, None, None)] {{(pid=118711) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 01 04:07:10.883250 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-369feb28-64f8-4080-a6b2-748175919211 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:07:10.883915 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-369feb28-64f8-4080-a6b2-748175919211 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] [instance: b904f233-887c-4c96-a2d2-f7f415ad852f] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:07:10.891589 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-369feb28-64f8-4080-a6b2-748175919211 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:07:10.896338 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-369feb28-64f8-4080-a6b2-748175919211 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:07:10.896338 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-369feb28-64f8-4080-a6b2-748175919211 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:07:10.896338 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-369feb28-64f8-4080-a6b2-748175919211 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:07:11.086489 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-369feb28-64f8-4080-a6b2-748175919211 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:07:11.101220 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-369feb28-64f8-4080-a6b2-748175919211 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:07:11.103432 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-369feb28-64f8-4080-a6b2-748175919211 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:07:11.104893 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-369feb28-64f8-4080-a6b2-748175919211 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] 10.222.0.20 "GET /compute/v2.1/servers/b904f233-887c-4c96-a2d2-f7f415ad852f" status: 200 len: 1664 microversion: 2.20 time: 0.226218 Jul 01 04:07:11.106251 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 151/294] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Jul 1 04:07:10 2022] GET /compute/v2.1/servers/b904f233-887c-4c96-a2d2-f7f415ad852f => generated 1664 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 04:07:11.128817 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-b9e18aa1-e96b-4cde-b4c3-5890ce62a1c3 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7c547c39-6b7b-4767-b335-286035bb76a5"}} {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 04:07:11.130699 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-b9e18aa1-e96b-4cde-b4c3-5890ce62a1c3 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] [instance: b904f233-887c-4c96-a2d2-f7f415ad852f] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:07:11.140576 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-b9e18aa1-e96b-4cde-b4c3-5890ce62a1c3 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:07:11.141504 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-b9e18aa1-e96b-4cde-b4c3-5890ce62a1c3 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:07:11.143005 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-b9e18aa1-e96b-4cde-b4c3-5890ce62a1c3 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:07:11.143619 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-b9e18aa1-e96b-4cde-b4c3-5890ce62a1c3 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:07:11.170955 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG dbcounter [-] [118712] Writing DB stats nova_cell1:SELECT=100 {{(pid=118712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:07:11.396176 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.virt.hardware [None req-839cc5aa-e946-4d0d-91a6-47ea4f392e91 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Flavor limits 0:0:0 {{(pid=118711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 01 04:07:11.397352 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.virt.hardware [None req-839cc5aa-e946-4d0d-91a6-47ea4f392e91 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Image limits 0:0:0 {{(pid=118711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 01 04:07:11.398184 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.virt.hardware [None req-839cc5aa-e946-4d0d-91a6-47ea4f392e91 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Flavor pref 0:0:0 {{(pid=118711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 01 04:07:11.399561 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.virt.hardware [None req-839cc5aa-e946-4d0d-91a6-47ea4f392e91 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Image pref 0:0:0 {{(pid=118711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 01 04:07:11.400310 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.virt.hardware [None req-839cc5aa-e946-4d0d-91a6-47ea4f392e91 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 01 04:07:11.425796 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-839cc5aa-e946-4d0d-91a6-47ea4f392e91 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:07:11.426573 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-839cc5aa-e946-4d0d-91a6-47ea4f392e91 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:07:11.428380 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-839cc5aa-e946-4d0d-91a6-47ea4f392e91 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:07:11.429142 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-839cc5aa-e946-4d0d-91a6-47ea4f392e91 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:07:11.467039 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.quota [None req-839cc5aa-e946-4d0d-91a6-47ea4f392e91 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Getting quotas for project 2940ca71c4b24b5facc194b61d748a11. Resources: {'ram', 'cores', 'instances'} {{(pid=118711) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 04:07:11.474977 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.quota [None req-839cc5aa-e946-4d0d-91a6-47ea4f392e91 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Getting quotas for user abc2e04754884398afc999d423e2a711 and project 2940ca71c4b24b5facc194b61d748a11. Resources: {'ram', 'cores', 'instances'} {{(pid=118711) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 04:07:11.500855 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-839cc5aa-e946-4d0d-91a6-47ea4f392e91 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Going to run 1 instances... {{(pid=118711) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 01 04:07:11.507109 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-839cc5aa-e946-4d0d-91a6-47ea4f392e91 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] [instance: 30391772-c0aa-468b-a414-c40c716a2481] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e1924e42-895f-4317-9e5b-596f5a2d3d23',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118711) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 01 04:07:11.675856 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-839cc5aa-e946-4d0d-91a6-47ea4f392e91 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.977820 Jul 01 04:07:11.677083 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 144/295] 10.222.0.20 () {60 vars in 1146 bytes} [Fri Jul 1 04:07:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 981 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 01 04:07:11.688229 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-62262850-cd28-40c1-9ffa-83264d4f7199 tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:07:11.689681 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-62262850-cd28-40c1-9ffa-83264d4f7199 tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] [instance: 16079191-5fa2-4add-8134-bf7d18446a6a] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:07:11.703607 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-62262850-cd28-40c1-9ffa-83264d4f7199 tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:07:11.704367 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-62262850-cd28-40c1-9ffa-83264d4f7199 tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:07:11.705514 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-62262850-cd28-40c1-9ffa-83264d4f7199 tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:07:11.706690 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-62262850-cd28-40c1-9ffa-83264d4f7199 tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:07:11.802785 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-62262850-cd28-40c1-9ffa-83264d4f7199 tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021817b0eef94fc2a19d90c511ec9298', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87ca5d9f50847d6ab501ca3a51ab37c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:07:11.813902 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-62262850-cd28-40c1-9ffa-83264d4f7199 tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] 10.222.0.20 "GET /compute/v2.1/servers/16079191-5fa2-4add-8134-bf7d18446a6a" status: 200 len: 1223 microversion: 2.1 time: 0.134676 Jul 01 04:07:11.832055 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 145/296] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:07:11 2022] GET /compute/v2.1/servers/16079191-5fa2-4add-8134-bf7d18446a6a => generated 1223 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:07:11.832055 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-c276878f-977d-4abb-8ab7-d236c4b6d0fd tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:07:11.832055 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-c276878f-977d-4abb-8ab7-d236c4b6d0fd tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] [instance: 1f96263a-e229-447e-aa6b-dd9c2872c751] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:07:11.836406 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-c276878f-977d-4abb-8ab7-d236c4b6d0fd tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:07:11.837033 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-c276878f-977d-4abb-8ab7-d236c4b6d0fd tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:07:11.837964 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-c276878f-977d-4abb-8ab7-d236c4b6d0fd tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:07:11.838512 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-c276878f-977d-4abb-8ab7-d236c4b6d0fd tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:07:12.029861 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-c276878f-977d-4abb-8ab7-d236c4b6d0fd tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8622ec5212c84d87b9b7c8f725012a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0143140d4f649478e36abcee284640c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:07:12.038122 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-c276878f-977d-4abb-8ab7-d236c4b6d0fd tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] 10.222.0.20 "GET /compute/v2.1/servers/1f96263a-e229-447e-aa6b-dd9c2872c751" status: 200 len: 1371 microversion: 2.1 time: 0.221627 Jul 01 04:07:12.038691 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 146/297] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:07:11 2022] GET /compute/v2.1/servers/1f96263a-e229-447e-aa6b-dd9c2872c751 => generated 1371 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:07:12.043582 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-1efbdf8a-c079-42c7-9a9e-ef1ef47f8a0a tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:07:12.044211 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-1efbdf8a-c079-42c7-9a9e-ef1ef47f8a0a tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] [instance: 30391772-c0aa-468b-a414-c40c716a2481] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:07:12.102760 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-1efbdf8a-c079-42c7-9a9e-ef1ef47f8a0a tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abc2e04754884398afc999d423e2a711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2940ca71c4b24b5facc194b61d748a11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:07:12.115641 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-1efbdf8a-c079-42c7-9a9e-ef1ef47f8a0a tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] 10.222.0.20 "GET /compute/v2.1/servers/30391772-c0aa-468b-a414-c40c716a2481" status: 200 len: 1258 microversion: 2.1 time: 0.075307 Jul 01 04:07:12.116736 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 147/298] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:07:12 2022] GET /compute/v2.1/servers/30391772-c0aa-468b-a414-c40c716a2481 => generated 1258 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:07:12.841078 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-a0b14318-3421-4e45-9181-01466b5672b4 tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:07:12.842119 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-a0b14318-3421-4e45-9181-01466b5672b4 tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] [instance: 16079191-5fa2-4add-8134-bf7d18446a6a] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:07:12.850606 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-a0b14318-3421-4e45-9181-01466b5672b4 tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:07:12.851144 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-a0b14318-3421-4e45-9181-01466b5672b4 tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:07:12.852065 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-a0b14318-3421-4e45-9181-01466b5672b4 tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:07:12.852522 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-a0b14318-3421-4e45-9181-01466b5672b4 tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:07:12.856435 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG dbcounter [-] [118711] Writing DB stats nova_cell1:SELECT=100 {{(pid=118711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:07:12.943159 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-a0b14318-3421-4e45-9181-01466b5672b4 tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021817b0eef94fc2a19d90c511ec9298', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87ca5d9f50847d6ab501ca3a51ab37c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:07:12.953774 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-a0b14318-3421-4e45-9181-01466b5672b4 tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] 10.222.0.20 "GET /compute/v2.1/servers/16079191-5fa2-4add-8134-bf7d18446a6a" status: 200 len: 1271 microversion: 2.1 time: 0.116951 Jul 01 04:07:12.954704 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 148/299] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:07:12 2022] GET /compute/v2.1/servers/16079191-5fa2-4add-8134-bf7d18446a6a => generated 1271 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:07:12.980145 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-b9e18aa1-e96b-4cde-b4c3-5890ce62a1c3 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] 10.222.0.20 "POST /compute/v2.1/servers/b904f233-887c-4c96-a2d2-f7f415ad852f/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.856952 Jul 01 04:07:12.988749 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 152/300] 10.222.0.20 () {62 vars in 1363 bytes} [Fri Jul 1 04:07:11 2022] POST /compute/v2.1/servers/b904f233-887c-4c96-a2d2-f7f415ad852f/os-volume_attachments => generated 188 bytes in 1867 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 01 04:07:13.069433 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-7a699e03-c5d0-4e87-a60d-5a1b0bf452ea tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:07:13.071124 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-7a699e03-c5d0-4e87-a60d-5a1b0bf452ea tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] [instance: 1f96263a-e229-447e-aa6b-dd9c2872c751] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:07:13.079177 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG dbcounter [-] [118711] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=118711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:07:13.088884 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-7a699e03-c5d0-4e87-a60d-5a1b0bf452ea tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:07:13.090292 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-7a699e03-c5d0-4e87-a60d-5a1b0bf452ea tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:07:13.094579 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-7a699e03-c5d0-4e87-a60d-5a1b0bf452ea tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:07:13.094579 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-7a699e03-c5d0-4e87-a60d-5a1b0bf452ea tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:07:13.143860 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-7ee3d61f-b77f-4bde-a6b6-9aa96201645b tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:07:13.149543 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-7ee3d61f-b77f-4bde-a6b6-9aa96201645b tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] [instance: 30391772-c0aa-468b-a414-c40c716a2481] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:07:13.238041 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-7ee3d61f-b77f-4bde-a6b6-9aa96201645b tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abc2e04754884398afc999d423e2a711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2940ca71c4b24b5facc194b61d748a11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:07:13.251946 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-7ee3d61f-b77f-4bde-a6b6-9aa96201645b tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] 10.222.0.20 "GET /compute/v2.1/servers/30391772-c0aa-468b-a414-c40c716a2481" status: 200 len: 1258 microversion: 2.1 time: 0.112303 Jul 01 04:07:13.253163 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 153/301] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:07:13 2022] GET /compute/v2.1/servers/30391772-c0aa-468b-a414-c40c716a2481 => generated 1258 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 04:07:13.263462 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-8dd2fb5b-6f14-4503-becc-f741e64365a1 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 04:07:13.264694 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-8dd2fb5b-6f14-4503-becc-f741e64365a1 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] [instance: b904f233-887c-4c96-a2d2-f7f415ad852f] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:07:13.299447 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-8dd2fb5b-6f14-4503-becc-f741e64365a1 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:07:13.299447 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-8dd2fb5b-6f14-4503-becc-f741e64365a1 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:07:13.299447 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-8dd2fb5b-6f14-4503-becc-f741e64365a1 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:07:13.299447 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-8dd2fb5b-6f14-4503-becc-f741e64365a1 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:07:13.678662 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-7a699e03-c5d0-4e87-a60d-5a1b0bf452ea tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8622ec5212c84d87b9b7c8f725012a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0143140d4f649478e36abcee284640c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:07:13.688730 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-7a699e03-c5d0-4e87-a60d-5a1b0bf452ea tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] 10.222.0.20 "GET /compute/v2.1/servers/1f96263a-e229-447e-aa6b-dd9c2872c751" status: 200 len: 1371 microversion: 2.1 time: 0.628844 Jul 01 04:07:13.690422 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 149/302] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:07:13 2022] GET /compute/v2.1/servers/1f96263a-e229-447e-aa6b-dd9c2872c751 => generated 1371 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:07:13.707589 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [req-31586240-d132-4e6f-829b-c74f42812a81 req-10ceebb5-7c1f-415b-8a95-ad1bb04d0a37 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f96263a-e229-447e-aa6b-dd9c2872c751", "name": "network-vif-plugged", "status": "completed", "tag": "562a39f3-c337-47af-9f9d-fabcdc36a52b"}]} {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 04:07:13.719742 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [req-31586240-d132-4e6f-829b-c74f42812a81 req-10ceebb5-7c1f-415b-8a95-ad1bb04d0a37 service nova] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:07:13.720289 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [req-31586240-d132-4e6f-829b-c74f42812a81 req-10ceebb5-7c1f-415b-8a95-ad1bb04d0a37 service nova] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:07:13.736162 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.compute.server_external_events [req-31586240-d132-4e6f-829b-c74f42812a81 req-10ceebb5-7c1f-415b-8a95-ad1bb04d0a37 service nova] Creating event network-vif-plugged:562a39f3-c337-47af-9f9d-fabcdc36a52b for instance 1f96263a-e229-447e-aa6b-dd9c2872c751 on hv-cinder-84684 Jul 01 04:07:13.738949 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-8dd2fb5b-6f14-4503-becc-f741e64365a1 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] 10.222.0.20 "POST /compute/v2.1/servers/b904f233-887c-4c96-a2d2-f7f415ad852f/action" status: 202 len: 0 microversion: 2.20 time: 0.483875 Jul 01 04:07:13.739742 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 154/303] 10.222.0.20 () {62 vars in 1318 bytes} [Fri Jul 1 04:07:13 2022] POST /compute/v2.1/servers/b904f233-887c-4c96-a2d2-f7f415ad852f/action => generated 0 bytes in 486 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 01 04:07:13.748648 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [req-31586240-d132-4e6f-829b-c74f42812a81 req-10ceebb5-7c1f-415b-8a95-ad1bb04d0a37 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045306 Jul 01 04:07:13.753510 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 150/304] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Jul 1 04:07:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 04:07:13.756318 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-8394a345-5400-499a-b453-6fdcb53aa73b tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:07:13.757474 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-8394a345-5400-499a-b453-6fdcb53aa73b tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] [instance: b904f233-887c-4c96-a2d2-f7f415ad852f] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:07:13.770484 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-8394a345-5400-499a-b453-6fdcb53aa73b tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:07:13.771333 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-8394a345-5400-499a-b453-6fdcb53aa73b tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:07:13.772797 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-8394a345-5400-499a-b453-6fdcb53aa73b tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:07:13.773633 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-8394a345-5400-499a-b453-6fdcb53aa73b tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:07:13.972014 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-8394a345-5400-499a-b453-6fdcb53aa73b tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:07:13.976156 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-6b1f6d80-34f4-41bd-b352-64e822ca4924 tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:07:13.978296 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-6b1f6d80-34f4-41bd-b352-64e822ca4924 tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] [instance: 16079191-5fa2-4add-8134-bf7d18446a6a] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:07:13.989685 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-6b1f6d80-34f4-41bd-b352-64e822ca4924 tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:07:13.990496 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-6b1f6d80-34f4-41bd-b352-64e822ca4924 tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:07:13.991908 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-6b1f6d80-34f4-41bd-b352-64e822ca4924 tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:07:13.992602 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-6b1f6d80-34f4-41bd-b352-64e822ca4924 tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:07:13.993160 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-8394a345-5400-499a-b453-6fdcb53aa73b tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:07:13.997359 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-8394a345-5400-499a-b453-6fdcb53aa73b tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:07:14.000970 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-8394a345-5400-499a-b453-6fdcb53aa73b tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] 10.222.0.20 "GET /compute/v2.1/servers/b904f233-887c-4c96-a2d2-f7f415ad852f" status: 200 len: 1750 microversion: 2.20 time: 0.254170 Jul 01 04:07:14.002007 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 155/305] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Jul 1 04:07:13 2022] GET /compute/v2.1/servers/b904f233-887c-4c96-a2d2-f7f415ad852f => generated 1750 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 01 04:07:14.088954 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-6b1f6d80-34f4-41bd-b352-64e822ca4924 tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021817b0eef94fc2a19d90c511ec9298', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87ca5d9f50847d6ab501ca3a51ab37c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:07:14.103259 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-6b1f6d80-34f4-41bd-b352-64e822ca4924 tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] 10.222.0.20 "GET /compute/v2.1/servers/16079191-5fa2-4add-8134-bf7d18446a6a" status: 200 len: 1279 microversion: 2.1 time: 0.135156 Jul 01 04:07:14.104339 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 151/306] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:07:13 2022] GET /compute/v2.1/servers/16079191-5fa2-4add-8134-bf7d18446a6a => generated 1279 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 04:07:14.270092 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-b3523a8b-a92f-4abf-907d-f76de4d37ef5 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:07:14.270707 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-b3523a8b-a92f-4abf-907d-f76de4d37ef5 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] [instance: 30391772-c0aa-468b-a414-c40c716a2481] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:07:14.278988 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-b3523a8b-a92f-4abf-907d-f76de4d37ef5 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:07:14.279665 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-b3523a8b-a92f-4abf-907d-f76de4d37ef5 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:07:14.280474 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-b3523a8b-a92f-4abf-907d-f76de4d37ef5 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:07:14.280912 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-b3523a8b-a92f-4abf-907d-f76de4d37ef5 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:07:14.358397 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-b3523a8b-a92f-4abf-907d-f76de4d37ef5 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abc2e04754884398afc999d423e2a711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2940ca71c4b24b5facc194b61d748a11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:07:14.371657 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-b3523a8b-a92f-4abf-907d-f76de4d37ef5 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] 10.222.0.20 "GET /compute/v2.1/servers/30391772-c0aa-468b-a414-c40c716a2481" status: 200 len: 1262 microversion: 2.1 time: 0.104721 Jul 01 04:07:14.374994 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 156/307] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:07:14 2022] GET /compute/v2.1/servers/30391772-c0aa-468b-a414-c40c716a2481 => generated 1262 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:07:14.725515 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-01ef472c-c4e9-4f82-ab46-048f54b30280 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:07:14.726706 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-01ef472c-c4e9-4f82-ab46-048f54b30280 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] [instance: 1f96263a-e229-447e-aa6b-dd9c2872c751] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:07:14.739955 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-01ef472c-c4e9-4f82-ab46-048f54b30280 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:07:14.741577 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-01ef472c-c4e9-4f82-ab46-048f54b30280 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:07:14.743534 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-01ef472c-c4e9-4f82-ab46-048f54b30280 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:07:14.744843 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-01ef472c-c4e9-4f82-ab46-048f54b30280 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:07:15.007723 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-01ef472c-c4e9-4f82-ab46-048f54b30280 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8622ec5212c84d87b9b7c8f725012a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0143140d4f649478e36abcee284640c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:07:15.020773 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-4a0b5633-be40-4b39-9e03-fb8395c14a18 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:07:15.021389 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-4a0b5633-be40-4b39-9e03-fb8395c14a18 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] [instance: b904f233-887c-4c96-a2d2-f7f415ad852f] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:07:15.026297 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-01ef472c-c4e9-4f82-ab46-048f54b30280 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] 10.222.0.20 "GET /compute/v2.1/servers/1f96263a-e229-447e-aa6b-dd9c2872c751" status: 200 len: 1371 microversion: 2.1 time: 0.322605 Jul 01 04:07:15.027208 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 152/308] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:07:14 2022] GET /compute/v2.1/servers/1f96263a-e229-447e-aa6b-dd9c2872c751 => generated 1371 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:07:15.040450 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-4a0b5633-be40-4b39-9e03-fb8395c14a18 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:07:15.042224 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-4a0b5633-be40-4b39-9e03-fb8395c14a18 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:07:15.044462 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-4a0b5633-be40-4b39-9e03-fb8395c14a18 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:07:15.047907 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-4a0b5633-be40-4b39-9e03-fb8395c14a18 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:07:15.125301 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-dd706c24-d25f-4dd9-9e63-b359c86b3cea tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:07:15.125988 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-dd706c24-d25f-4dd9-9e63-b359c86b3cea tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] [instance: 16079191-5fa2-4add-8134-bf7d18446a6a] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:07:15.133480 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-dd706c24-d25f-4dd9-9e63-b359c86b3cea tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:07:15.134014 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-dd706c24-d25f-4dd9-9e63-b359c86b3cea tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:07:15.134831 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-dd706c24-d25f-4dd9-9e63-b359c86b3cea tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:07:15.135310 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-dd706c24-d25f-4dd9-9e63-b359c86b3cea tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:07:15.248797 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-dd706c24-d25f-4dd9-9e63-b359c86b3cea tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021817b0eef94fc2a19d90c511ec9298', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87ca5d9f50847d6ab501ca3a51ab37c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:07:15.257710 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-dd706c24-d25f-4dd9-9e63-b359c86b3cea tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] 10.222.0.20 "GET /compute/v2.1/servers/16079191-5fa2-4add-8134-bf7d18446a6a" status: 200 len: 1279 microversion: 2.1 time: 0.138735 Jul 01 04:07:15.259172 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 153/309] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:07:15 2022] GET /compute/v2.1/servers/16079191-5fa2-4add-8134-bf7d18446a6a => generated 1279 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:07:15.281547 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-4a0b5633-be40-4b39-9e03-fb8395c14a18 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:07:15.291848 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-4a0b5633-be40-4b39-9e03-fb8395c14a18 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:07:15.294116 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-4a0b5633-be40-4b39-9e03-fb8395c14a18 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:07:15.295416 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-4a0b5633-be40-4b39-9e03-fb8395c14a18 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] 10.222.0.20 "GET /compute/v2.1/servers/b904f233-887c-4c96-a2d2-f7f415ad852f" status: 200 len: 1750 microversion: 2.20 time: 0.278772 Jul 01 04:07:15.296068 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 157/310] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Jul 1 04:07:15 2022] GET /compute/v2.1/servers/b904f233-887c-4c96-a2d2-f7f415ad852f => generated 1750 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 01 04:07:15.395845 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-9618c0ee-a0a0-47ae-9b42-75f409cde707 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:07:15.396719 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-9618c0ee-a0a0-47ae-9b42-75f409cde707 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] [instance: 30391772-c0aa-468b-a414-c40c716a2481] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:07:15.404230 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-9618c0ee-a0a0-47ae-9b42-75f409cde707 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:07:15.404974 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-9618c0ee-a0a0-47ae-9b42-75f409cde707 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:07:15.405956 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-9618c0ee-a0a0-47ae-9b42-75f409cde707 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:07:15.406607 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-9618c0ee-a0a0-47ae-9b42-75f409cde707 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:07:15.507131 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-9618c0ee-a0a0-47ae-9b42-75f409cde707 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abc2e04754884398afc999d423e2a711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2940ca71c4b24b5facc194b61d748a11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:07:15.517402 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-9618c0ee-a0a0-47ae-9b42-75f409cde707 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] 10.222.0.20 "GET /compute/v2.1/servers/30391772-c0aa-468b-a414-c40c716a2481" status: 200 len: 1262 microversion: 2.1 time: 0.126700 Jul 01 04:07:15.530530 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 154/311] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:07:15 2022] GET /compute/v2.1/servers/30391772-c0aa-468b-a414-c40c716a2481 => generated 1262 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:07:16.055804 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-0dbb6d01-73d1-4ac8-8786-6f5676a30b88 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:07:16.056596 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-0dbb6d01-73d1-4ac8-8786-6f5676a30b88 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] [instance: 1f96263a-e229-447e-aa6b-dd9c2872c751] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:07:16.064724 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-0dbb6d01-73d1-4ac8-8786-6f5676a30b88 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:07:16.065262 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-0dbb6d01-73d1-4ac8-8786-6f5676a30b88 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:07:16.066330 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-0dbb6d01-73d1-4ac8-8786-6f5676a30b88 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:07:16.066863 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-0dbb6d01-73d1-4ac8-8786-6f5676a30b88 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:07:16.289302 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-0bba2160-2d14-4ca3-b6f6-43e467254009 tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:07:16.290365 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-0bba2160-2d14-4ca3-b6f6-43e467254009 tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] [instance: 16079191-5fa2-4add-8134-bf7d18446a6a] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:07:16.303587 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-0dbb6d01-73d1-4ac8-8786-6f5676a30b88 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8622ec5212c84d87b9b7c8f725012a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0143140d4f649478e36abcee284640c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:07:16.312699 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-0bba2160-2d14-4ca3-b6f6-43e467254009 tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:07:16.313152 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-0bba2160-2d14-4ca3-b6f6-43e467254009 tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:07:16.314207 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-0bba2160-2d14-4ca3-b6f6-43e467254009 tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:07:16.317043 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-0bba2160-2d14-4ca3-b6f6-43e467254009 tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:07:16.317230 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-0dbb6d01-73d1-4ac8-8786-6f5676a30b88 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] 10.222.0.20 "GET /compute/v2.1/servers/1f96263a-e229-447e-aa6b-dd9c2872c751" status: 200 len: 1371 microversion: 2.1 time: 0.274890 Jul 01 04:07:16.317230 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 158/312] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:07:16 2022] GET /compute/v2.1/servers/1f96263a-e229-447e-aa6b-dd9c2872c751 => generated 1371 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:07:16.323917 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-349ee0a9-a317-4555-b64b-2313c0a0f0b6 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:07:16.324965 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-349ee0a9-a317-4555-b64b-2313c0a0f0b6 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] [instance: b904f233-887c-4c96-a2d2-f7f415ad852f] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:07:16.331637 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-349ee0a9-a317-4555-b64b-2313c0a0f0b6 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:07:16.332312 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-349ee0a9-a317-4555-b64b-2313c0a0f0b6 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:07:16.333236 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-349ee0a9-a317-4555-b64b-2313c0a0f0b6 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:07:16.333749 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-349ee0a9-a317-4555-b64b-2313c0a0f0b6 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:07:16.407771 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-0bba2160-2d14-4ca3-b6f6-43e467254009 tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021817b0eef94fc2a19d90c511ec9298', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87ca5d9f50847d6ab501ca3a51ab37c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:07:16.415369 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-0bba2160-2d14-4ca3-b6f6-43e467254009 tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] 10.222.0.20 "GET /compute/v2.1/servers/16079191-5fa2-4add-8134-bf7d18446a6a" status: 200 len: 1277 microversion: 2.1 time: 0.134910 Jul 01 04:07:16.415953 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 155/313] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:07:16 2022] GET /compute/v2.1/servers/16079191-5fa2-4add-8134-bf7d18446a6a => generated 1277 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 04:07:16.785828 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-6c5e8f84-f1d8-4279-94f9-438a82b55794 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:07:16.785828 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-6c5e8f84-f1d8-4279-94f9-438a82b55794 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] [instance: 30391772-c0aa-468b-a414-c40c716a2481] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:07:16.785828 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-6c5e8f84-f1d8-4279-94f9-438a82b55794 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:07:16.785828 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-6c5e8f84-f1d8-4279-94f9-438a82b55794 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:07:16.788564 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-6c5e8f84-f1d8-4279-94f9-438a82b55794 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:07:16.788564 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-6c5e8f84-f1d8-4279-94f9-438a82b55794 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:07:16.789443 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-349ee0a9-a317-4555-b64b-2313c0a0f0b6 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:07:16.789443 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-349ee0a9-a317-4555-b64b-2313c0a0f0b6 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:07:16.789656 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-349ee0a9-a317-4555-b64b-2313c0a0f0b6 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:07:16.789656 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-349ee0a9-a317-4555-b64b-2313c0a0f0b6 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] 10.222.0.20 "GET /compute/v2.1/servers/b904f233-887c-4c96-a2d2-f7f415ad852f" status: 200 len: 1750 microversion: 2.20 time: 0.266389 Jul 01 04:07:16.789656 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 159/314] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Jul 1 04:07:16 2022] GET /compute/v2.1/servers/b904f233-887c-4c96-a2d2-f7f415ad852f => generated 1750 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 01 04:07:16.789928 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-6c5e8f84-f1d8-4279-94f9-438a82b55794 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abc2e04754884398afc999d423e2a711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2940ca71c4b24b5facc194b61d748a11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:07:16.789928 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-6c5e8f84-f1d8-4279-94f9-438a82b55794 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] 10.222.0.20 "GET /compute/v2.1/servers/30391772-c0aa-468b-a414-c40c716a2481" status: 200 len: 1310 microversion: 2.1 time: 0.128230 Jul 01 04:07:16.789928 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 156/315] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:07:16 2022] GET /compute/v2.1/servers/30391772-c0aa-468b-a414-c40c716a2481 => generated 1310 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:07:17.345858 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-02c5139a-bf7b-4b27-80a3-cd4ecf3e40bf tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:07:17.345858 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-02c5139a-bf7b-4b27-80a3-cd4ecf3e40bf tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] [instance: 1f96263a-e229-447e-aa6b-dd9c2872c751] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:07:17.360394 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-02c5139a-bf7b-4b27-80a3-cd4ecf3e40bf tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:07:17.362285 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-02c5139a-bf7b-4b27-80a3-cd4ecf3e40bf tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:07:17.364379 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-02c5139a-bf7b-4b27-80a3-cd4ecf3e40bf tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:07:17.365936 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-02c5139a-bf7b-4b27-80a3-cd4ecf3e40bf tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:07:17.435678 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-069506ab-fbdb-4a6b-9f13-7abb5aa829ca tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:07:17.437076 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-069506ab-fbdb-4a6b-9f13-7abb5aa829ca tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] [instance: 16079191-5fa2-4add-8134-bf7d18446a6a] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:07:17.448616 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-069506ab-fbdb-4a6b-9f13-7abb5aa829ca tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:07:17.450454 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-069506ab-fbdb-4a6b-9f13-7abb5aa829ca tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:07:17.451616 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-069506ab-fbdb-4a6b-9f13-7abb5aa829ca tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:07:17.452415 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-069506ab-fbdb-4a6b-9f13-7abb5aa829ca tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:07:17.685269 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-069506ab-fbdb-4a6b-9f13-7abb5aa829ca tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021817b0eef94fc2a19d90c511ec9298', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87ca5d9f50847d6ab501ca3a51ab37c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:07:17.702856 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-069506ab-fbdb-4a6b-9f13-7abb5aa829ca tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] 10.222.0.20 "GET /compute/v2.1/servers/16079191-5fa2-4add-8134-bf7d18446a6a" status: 200 len: 1319 microversion: 2.1 time: 0.272054 Jul 01 04:07:17.707639 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 157/316] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:07:17 2022] GET /compute/v2.1/servers/16079191-5fa2-4add-8134-bf7d18446a6a => generated 1319 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 04:07:17.723685 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-37338aca-e1ba-4fcc-8aad-ffbdbcaeabac tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:07:17.724944 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-37338aca-e1ba-4fcc-8aad-ffbdbcaeabac tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] [instance: b904f233-887c-4c96-a2d2-f7f415ad852f] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:07:17.760523 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-37338aca-e1ba-4fcc-8aad-ffbdbcaeabac tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:07:17.761300 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-37338aca-e1ba-4fcc-8aad-ffbdbcaeabac tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:07:17.763271 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-37338aca-e1ba-4fcc-8aad-ffbdbcaeabac tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:07:17.765499 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-37338aca-e1ba-4fcc-8aad-ffbdbcaeabac tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:07:17.838000 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-02c5139a-bf7b-4b27-80a3-cd4ecf3e40bf tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8622ec5212c84d87b9b7c8f725012a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0143140d4f649478e36abcee284640c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:07:17.838000 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-02c5139a-bf7b-4b27-80a3-cd4ecf3e40bf tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] 10.222.0.20 "GET /compute/v2.1/servers/1f96263a-e229-447e-aa6b-dd9c2872c751" status: 200 len: 1371 microversion: 2.1 time: 0.472543 Jul 01 04:07:17.838000 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 160/317] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:07:17 2022] GET /compute/v2.1/servers/1f96263a-e229-447e-aa6b-dd9c2872c751 => generated 1371 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:07:17.838000 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-d27da083-1d88-4601-87d8-8dfe060ad312 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:07:17.840663 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-d27da083-1d88-4601-87d8-8dfe060ad312 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] [instance: 30391772-c0aa-468b-a414-c40c716a2481] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:07:17.840663 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-d27da083-1d88-4601-87d8-8dfe060ad312 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:07:17.840663 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-d27da083-1d88-4601-87d8-8dfe060ad312 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:07:17.840663 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-d27da083-1d88-4601-87d8-8dfe060ad312 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:07:17.841210 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-d27da083-1d88-4601-87d8-8dfe060ad312 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:07:17.922173 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-d27da083-1d88-4601-87d8-8dfe060ad312 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abc2e04754884398afc999d423e2a711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2940ca71c4b24b5facc194b61d748a11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:07:17.937814 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-d27da083-1d88-4601-87d8-8dfe060ad312 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] 10.222.0.20 "GET /compute/v2.1/servers/30391772-c0aa-468b-a414-c40c716a2481" status: 200 len: 1318 microversion: 2.1 time: 0.121660 Jul 01 04:07:17.939621 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 161/318] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:07:17 2022] GET /compute/v2.1/servers/30391772-c0aa-468b-a414-c40c716a2481 => generated 1318 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:07:18.193110 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-37338aca-e1ba-4fcc-8aad-ffbdbcaeabac tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:07:18.208672 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-37338aca-e1ba-4fcc-8aad-ffbdbcaeabac tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:07:18.211671 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-37338aca-e1ba-4fcc-8aad-ffbdbcaeabac tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:07:18.213294 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-37338aca-e1ba-4fcc-8aad-ffbdbcaeabac tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] 10.222.0.20 "GET /compute/v2.1/servers/b904f233-887c-4c96-a2d2-f7f415ad852f" status: 200 len: 1752 microversion: 2.20 time: 0.503417 Jul 01 04:07:18.214570 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 158/319] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Jul 1 04:07:17 2022] GET /compute/v2.1/servers/b904f233-887c-4c96-a2d2-f7f415ad852f => generated 1752 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 04:07:18.456611 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [req-7125c213-8993-434e-b5d1-7ea165ac167a req-7eb66daa-cdbf-40de-8b38-aff5c6044ca2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "16079191-5fa2-4add-8134-bf7d18446a6a", "tag": "6c8a3556-dbf6-4a9c-a921-5f5d03d9714c"}]} {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 04:07:18.492605 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [req-7125c213-8993-434e-b5d1-7ea165ac167a req-7eb66daa-cdbf-40de-8b38-aff5c6044ca2 service nova] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:07:18.494902 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [req-7125c213-8993-434e-b5d1-7ea165ac167a req-7eb66daa-cdbf-40de-8b38-aff5c6044ca2 service nova] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:07:18.523941 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.compute.server_external_events [req-7125c213-8993-434e-b5d1-7ea165ac167a req-7eb66daa-cdbf-40de-8b38-aff5c6044ca2 service nova] Creating event network-changed:6c8a3556-dbf6-4a9c-a921-5f5d03d9714c for instance 16079191-5fa2-4add-8134-bf7d18446a6a on hv-cinder-84684 Jul 01 04:07:18.532486 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [req-7125c213-8993-434e-b5d1-7ea165ac167a req-7eb66daa-cdbf-40de-8b38-aff5c6044ca2 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083116 Jul 01 04:07:18.534627 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 162/320] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Jul 1 04:07:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 04:07:18.729341 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-57993c8e-6fb1-4ca3-9af1-5852f4a13421 tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:07:18.733782 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-57993c8e-6fb1-4ca3-9af1-5852f4a13421 tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] [instance: 16079191-5fa2-4add-8134-bf7d18446a6a] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:07:18.740220 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-57993c8e-6fb1-4ca3-9af1-5852f4a13421 tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:07:18.740971 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-57993c8e-6fb1-4ca3-9af1-5852f4a13421 tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:07:18.742260 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-57993c8e-6fb1-4ca3-9af1-5852f4a13421 tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:07:18.742981 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-57993c8e-6fb1-4ca3-9af1-5852f4a13421 tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:07:18.820102 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-bc749d6c-c638-4059-a537-1eb4f6c0da4e tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:07:18.821247 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-bc749d6c-c638-4059-a537-1eb4f6c0da4e tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] [instance: 1f96263a-e229-447e-aa6b-dd9c2872c751] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:07:18.828553 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-bc749d6c-c638-4059-a537-1eb4f6c0da4e tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:07:18.829400 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-bc749d6c-c638-4059-a537-1eb4f6c0da4e tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:07:18.830337 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-bc749d6c-c638-4059-a537-1eb4f6c0da4e tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:07:18.831106 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-bc749d6c-c638-4059-a537-1eb4f6c0da4e tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:07:19.009187 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-57993c8e-6fb1-4ca3-9af1-5852f4a13421 tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021817b0eef94fc2a19d90c511ec9298', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87ca5d9f50847d6ab501ca3a51ab37c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:07:19.029051 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-57993c8e-6fb1-4ca3-9af1-5852f4a13421 tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] 10.222.0.20 "GET /compute/v2.1/servers/16079191-5fa2-4add-8134-bf7d18446a6a" status: 200 len: 1319 microversion: 2.1 time: 0.303510 Jul 01 04:07:19.031737 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 159/321] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:07:18 2022] GET /compute/v2.1/servers/16079191-5fa2-4add-8134-bf7d18446a6a => generated 1319 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 04:07:19.043549 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-80f0a09e-7199-4a5b-8a14-db7d55ffeed8 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:07:19.062267 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-80f0a09e-7199-4a5b-8a14-db7d55ffeed8 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] [instance: 30391772-c0aa-468b-a414-c40c716a2481] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:07:19.063312 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-bc749d6c-c638-4059-a537-1eb4f6c0da4e tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8622ec5212c84d87b9b7c8f725012a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0143140d4f649478e36abcee284640c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:07:19.070880 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-80f0a09e-7199-4a5b-8a14-db7d55ffeed8 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:07:19.072031 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-bc749d6c-c638-4059-a537-1eb4f6c0da4e tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] 10.222.0.20 "GET /compute/v2.1/servers/1f96263a-e229-447e-aa6b-dd9c2872c751" status: 200 len: 1565 microversion: 2.1 time: 0.256430 Jul 01 04:07:19.072374 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-80f0a09e-7199-4a5b-8a14-db7d55ffeed8 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:07:19.073717 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-80f0a09e-7199-4a5b-8a14-db7d55ffeed8 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:07:19.075042 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-80f0a09e-7199-4a5b-8a14-db7d55ffeed8 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:07:19.076291 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 163/322] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:07:18 2022] GET /compute/v2.1/servers/1f96263a-e229-447e-aa6b-dd9c2872c751 => generated 1565 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 04:07:19.109707 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-0405f8fa-3ccd-4383-a56a-785b1376edd3 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:07:19.111624 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-0405f8fa-3ccd-4383-a56a-785b1376edd3 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] [instance: 1f96263a-e229-447e-aa6b-dd9c2872c751] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:07:19.128455 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-0405f8fa-3ccd-4383-a56a-785b1376edd3 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:07:19.128940 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-0405f8fa-3ccd-4383-a56a-785b1376edd3 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:07:19.132486 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-0405f8fa-3ccd-4383-a56a-785b1376edd3 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:07:19.136132 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-0405f8fa-3ccd-4383-a56a-785b1376edd3 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:07:19.319384 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-0405f8fa-3ccd-4383-a56a-785b1376edd3 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] 10.222.0.20 "GET /compute/v2.1/servers/1f96263a-e229-447e-aa6b-dd9c2872c751/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.217255 Jul 01 04:07:19.320416 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 164/323] 10.222.0.20 () {58 vars in 1274 bytes} [Fri Jul 1 04:07:19 2022] GET /compute/v2.1/servers/1f96263a-e229-447e-aa6b-dd9c2872c751/os-interface => generated 284 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 04:07:19.326537 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-fa2804a2-817b-4b48-9e46-0bb83b65513f tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:07:19.327258 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-fa2804a2-817b-4b48-9e46-0bb83b65513f tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] [instance: b904f233-887c-4c96-a2d2-f7f415ad852f] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:07:19.334176 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-fa2804a2-817b-4b48-9e46-0bb83b65513f tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:07:19.336159 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-fa2804a2-817b-4b48-9e46-0bb83b65513f tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:07:19.336159 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-fa2804a2-817b-4b48-9e46-0bb83b65513f tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:07:19.336159 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-fa2804a2-817b-4b48-9e46-0bb83b65513f tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:07:19.456830 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-80f0a09e-7199-4a5b-8a14-db7d55ffeed8 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abc2e04754884398afc999d423e2a711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2940ca71c4b24b5facc194b61d748a11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:07:19.468919 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-80f0a09e-7199-4a5b-8a14-db7d55ffeed8 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] 10.222.0.20 "GET /compute/v2.1/servers/30391772-c0aa-468b-a414-c40c716a2481" status: 200 len: 1358 microversion: 2.1 time: 0.433530 Jul 01 04:07:19.470263 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 160/324] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:07:19 2022] GET /compute/v2.1/servers/30391772-c0aa-468b-a414-c40c716a2481 => generated 1358 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:07:19.513439 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-fa2804a2-817b-4b48-9e46-0bb83b65513f tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:07:19.525093 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-fa2804a2-817b-4b48-9e46-0bb83b65513f tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:07:19.526777 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-fa2804a2-817b-4b48-9e46-0bb83b65513f tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:07:19.528171 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-fa2804a2-817b-4b48-9e46-0bb83b65513f tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] 10.222.0.20 "GET /compute/v2.1/servers/b904f233-887c-4c96-a2d2-f7f415ad852f" status: 200 len: 1752 microversion: 2.20 time: 0.206590 Jul 01 04:07:19.528815 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 165/325] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Jul 1 04:07:19 2022] GET /compute/v2.1/servers/b904f233-887c-4c96-a2d2-f7f415ad852f => generated 1752 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 04:07:20.059920 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-38329c89-ebe8-4221-973c-5457d8ca72ce tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:07:20.060562 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-38329c89-ebe8-4221-973c-5457d8ca72ce tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] [instance: 16079191-5fa2-4add-8134-bf7d18446a6a] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:07:20.067790 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-38329c89-ebe8-4221-973c-5457d8ca72ce tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:07:20.068245 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-38329c89-ebe8-4221-973c-5457d8ca72ce tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:07:20.069040 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-38329c89-ebe8-4221-973c-5457d8ca72ce tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:07:20.069474 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-38329c89-ebe8-4221-973c-5457d8ca72ce tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:07:20.298607 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-38329c89-ebe8-4221-973c-5457d8ca72ce tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021817b0eef94fc2a19d90c511ec9298', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87ca5d9f50847d6ab501ca3a51ab37c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:07:20.309541 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-38329c89-ebe8-4221-973c-5457d8ca72ce tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] 10.222.0.20 "GET /compute/v2.1/servers/16079191-5fa2-4add-8134-bf7d18446a6a" status: 200 len: 1319 microversion: 2.1 time: 0.255026 Jul 01 04:07:20.310267 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 161/326] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:07:20 2022] GET /compute/v2.1/servers/16079191-5fa2-4add-8134-bf7d18446a6a => generated 1319 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:07:20.495213 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-d871be24-1bc7-47a4-a722-acfbc59a4a6e tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:07:20.496863 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-d871be24-1bc7-47a4-a722-acfbc59a4a6e tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] [instance: 30391772-c0aa-468b-a414-c40c716a2481] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:07:20.503022 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-d871be24-1bc7-47a4-a722-acfbc59a4a6e tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:07:20.503506 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-d871be24-1bc7-47a4-a722-acfbc59a4a6e tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:07:20.504304 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-d871be24-1bc7-47a4-a722-acfbc59a4a6e tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:07:20.504747 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-d871be24-1bc7-47a4-a722-acfbc59a4a6e tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:07:20.556333 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-1471b08e-c710-42be-90bf-308d1b2fa4a7 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:07:20.558259 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-1471b08e-c710-42be-90bf-308d1b2fa4a7 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] [instance: b904f233-887c-4c96-a2d2-f7f415ad852f] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:07:20.573242 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-1471b08e-c710-42be-90bf-308d1b2fa4a7 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:07:20.573819 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-1471b08e-c710-42be-90bf-308d1b2fa4a7 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:07:20.575137 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-1471b08e-c710-42be-90bf-308d1b2fa4a7 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:07:20.575637 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-1471b08e-c710-42be-90bf-308d1b2fa4a7 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:07:20.657212 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-d871be24-1bc7-47a4-a722-acfbc59a4a6e tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abc2e04754884398afc999d423e2a711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2940ca71c4b24b5facc194b61d748a11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:07:20.666069 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-d871be24-1bc7-47a4-a722-acfbc59a4a6e tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] 10.222.0.20 "GET /compute/v2.1/servers/30391772-c0aa-468b-a414-c40c716a2481" status: 200 len: 1358 microversion: 2.1 time: 0.174759 Jul 01 04:07:20.667038 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 166/327] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:07:20 2022] GET /compute/v2.1/servers/30391772-c0aa-468b-a414-c40c716a2481 => generated 1358 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:07:20.672758 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [req-b4713eb5-4220-4585-a8f1-272d5c87a5c7 req-f074d4a1-c9b6-4970-86f1-fe1c00405fc8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1f96263a-e229-447e-aa6b-dd9c2872c751", "tag": "562a39f3-c337-47af-9f9d-fabcdc36a52b"}]} {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 04:07:20.681779 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [req-b4713eb5-4220-4585-a8f1-272d5c87a5c7 req-f074d4a1-c9b6-4970-86f1-fe1c00405fc8 service nova] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:07:20.682434 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [req-b4713eb5-4220-4585-a8f1-272d5c87a5c7 req-f074d4a1-c9b6-4970-86f1-fe1c00405fc8 service nova] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:07:20.695647 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.compute.server_external_events [req-b4713eb5-4220-4585-a8f1-272d5c87a5c7 req-f074d4a1-c9b6-4970-86f1-fe1c00405fc8 service nova] Creating event network-changed:562a39f3-c337-47af-9f9d-fabcdc36a52b for instance 1f96263a-e229-447e-aa6b-dd9c2872c751 on hv-cinder-84684 Jul 01 04:07:20.702029 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [req-b4713eb5-4220-4585-a8f1-272d5c87a5c7 req-f074d4a1-c9b6-4970-86f1-fe1c00405fc8 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033391 Jul 01 04:07:20.702679 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 167/328] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Jul 1 04:07:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 04:07:20.735575 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-1471b08e-c710-42be-90bf-308d1b2fa4a7 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:07:20.744956 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-1471b08e-c710-42be-90bf-308d1b2fa4a7 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:07:20.746511 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-1471b08e-c710-42be-90bf-308d1b2fa4a7 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:07:20.747818 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-1471b08e-c710-42be-90bf-308d1b2fa4a7 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] 10.222.0.20 "GET /compute/v2.1/servers/b904f233-887c-4c96-a2d2-f7f415ad852f" status: 200 len: 1752 microversion: 2.20 time: 0.203321 Jul 01 04:07:20.748379 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 162/329] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Jul 1 04:07:20 2022] GET /compute/v2.1/servers/b904f233-887c-4c96-a2d2-f7f415ad852f => generated 1752 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 04:07:21.337843 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-015b3c1f-0cbf-4ddf-a92f-d7e6c093c8fa tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:07:21.354326 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-015b3c1f-0cbf-4ddf-a92f-d7e6c093c8fa tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] [instance: 16079191-5fa2-4add-8134-bf7d18446a6a] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:07:21.368966 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-015b3c1f-0cbf-4ddf-a92f-d7e6c093c8fa tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:07:21.368966 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-015b3c1f-0cbf-4ddf-a92f-d7e6c093c8fa tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:07:21.369735 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-015b3c1f-0cbf-4ddf-a92f-d7e6c093c8fa tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:07:21.370510 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-015b3c1f-0cbf-4ddf-a92f-d7e6c093c8fa tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:07:21.392830 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG dbcounter [-] [118712] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=118712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:07:21.635844 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-015b3c1f-0cbf-4ddf-a92f-d7e6c093c8fa tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021817b0eef94fc2a19d90c511ec9298', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87ca5d9f50847d6ab501ca3a51ab37c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:07:21.655333 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-015b3c1f-0cbf-4ddf-a92f-d7e6c093c8fa tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] 10.222.0.20 "GET /compute/v2.1/servers/16079191-5fa2-4add-8134-bf7d18446a6a" status: 200 len: 1319 microversion: 2.1 time: 0.324821 Jul 01 04:07:21.656801 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 168/330] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:07:21 2022] GET /compute/v2.1/servers/16079191-5fa2-4add-8134-bf7d18446a6a => generated 1319 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:07:21.684372 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-688847dd-ffd2-485a-be54-7d9957ecfbfc tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:07:21.685330 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-688847dd-ffd2-485a-be54-7d9957ecfbfc tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] [instance: 30391772-c0aa-468b-a414-c40c716a2481] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:07:21.689488 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG dbcounter [-] [118711] Writing DB stats nova_cell0:SELECT=4 {{(pid=118711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:07:21.694955 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-688847dd-ffd2-485a-be54-7d9957ecfbfc tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:07:21.695878 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-688847dd-ffd2-485a-be54-7d9957ecfbfc tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:07:21.696915 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-688847dd-ffd2-485a-be54-7d9957ecfbfc tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:07:21.699798 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-688847dd-ffd2-485a-be54-7d9957ecfbfc tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:07:21.767771 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-1eee1328-3db1-4775-ab03-f40f96942485 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:07:21.769223 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-1eee1328-3db1-4775-ab03-f40f96942485 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] [instance: b904f233-887c-4c96-a2d2-f7f415ad852f] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:07:21.777939 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-1eee1328-3db1-4775-ab03-f40f96942485 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:07:21.778484 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-1eee1328-3db1-4775-ab03-f40f96942485 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:07:21.779602 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-1eee1328-3db1-4775-ab03-f40f96942485 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:07:21.781415 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-1eee1328-3db1-4775-ab03-f40f96942485 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:07:21.910690 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-688847dd-ffd2-485a-be54-7d9957ecfbfc tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abc2e04754884398afc999d423e2a711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2940ca71c4b24b5facc194b61d748a11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:07:21.938090 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-688847dd-ffd2-485a-be54-7d9957ecfbfc tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] 10.222.0.20 "GET /compute/v2.1/servers/30391772-c0aa-468b-a414-c40c716a2481" status: 200 len: 1358 microversion: 2.1 time: 0.259535 Jul 01 04:07:21.949148 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 163/331] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:07:21 2022] GET /compute/v2.1/servers/30391772-c0aa-468b-a414-c40c716a2481 => generated 1358 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:07:22.016422 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-1eee1328-3db1-4775-ab03-f40f96942485 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:07:22.033751 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-1eee1328-3db1-4775-ab03-f40f96942485 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:07:22.035593 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-1eee1328-3db1-4775-ab03-f40f96942485 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:07:22.047749 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-1eee1328-3db1-4775-ab03-f40f96942485 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] 10.222.0.20 "GET /compute/v2.1/servers/b904f233-887c-4c96-a2d2-f7f415ad852f" status: 200 len: 1752 microversion: 2.20 time: 0.274719 Jul 01 04:07:22.067755 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 169/332] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Jul 1 04:07:21 2022] GET /compute/v2.1/servers/b904f233-887c-4c96-a2d2-f7f415ad852f => generated 1752 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 04:07:22.673938 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-89680ff7-6ea0-47c2-a742-d7ce9a1417e6 tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:07:22.679340 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-89680ff7-6ea0-47c2-a742-d7ce9a1417e6 tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] [instance: 16079191-5fa2-4add-8134-bf7d18446a6a] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:07:22.679340 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG dbcounter [-] [118711] Writing DB stats nova_cell0:SELECT=22 {{(pid=118711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:07:22.681639 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-89680ff7-6ea0-47c2-a742-d7ce9a1417e6 tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:07:22.682099 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-89680ff7-6ea0-47c2-a742-d7ce9a1417e6 tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:07:22.682869 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-89680ff7-6ea0-47c2-a742-d7ce9a1417e6 tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:07:22.683841 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-89680ff7-6ea0-47c2-a742-d7ce9a1417e6 tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:07:22.875582 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-89680ff7-6ea0-47c2-a742-d7ce9a1417e6 tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021817b0eef94fc2a19d90c511ec9298', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87ca5d9f50847d6ab501ca3a51ab37c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:07:22.885293 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-89680ff7-6ea0-47c2-a742-d7ce9a1417e6 tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] 10.222.0.20 "GET /compute/v2.1/servers/16079191-5fa2-4add-8134-bf7d18446a6a" status: 200 len: 1319 microversion: 2.1 time: 0.215952 Jul 01 04:07:22.886123 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 164/333] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:07:22 2022] GET /compute/v2.1/servers/16079191-5fa2-4add-8134-bf7d18446a6a => generated 1319 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:07:22.965501 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-1de8d50e-d3ce-48e3-9783-2b75a1836231 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:07:22.966481 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-1de8d50e-d3ce-48e3-9783-2b75a1836231 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] [instance: 30391772-c0aa-468b-a414-c40c716a2481] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:07:22.981245 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-1de8d50e-d3ce-48e3-9783-2b75a1836231 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:07:22.982531 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-1de8d50e-d3ce-48e3-9783-2b75a1836231 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:07:22.984550 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-1de8d50e-d3ce-48e3-9783-2b75a1836231 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:07:22.985764 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-1de8d50e-d3ce-48e3-9783-2b75a1836231 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:07:23.084213 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-b9b023a9-c97a-49d7-803c-f2384301fe00 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:07:23.089757 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-b9b023a9-c97a-49d7-803c-f2384301fe00 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] [instance: b904f233-887c-4c96-a2d2-f7f415ad852f] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:07:23.099380 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-b9b023a9-c97a-49d7-803c-f2384301fe00 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:07:23.100502 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-b9b023a9-c97a-49d7-803c-f2384301fe00 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:07:23.102124 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-b9b023a9-c97a-49d7-803c-f2384301fe00 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:07:23.103906 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-b9b023a9-c97a-49d7-803c-f2384301fe00 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:07:23.148613 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG dbcounter [-] [118711] Writing DB stats nova_cell1:SELECT=100 {{(pid=118711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:07:23.203139 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-1de8d50e-d3ce-48e3-9783-2b75a1836231 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abc2e04754884398afc999d423e2a711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2940ca71c4b24b5facc194b61d748a11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:07:23.211416 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-1de8d50e-d3ce-48e3-9783-2b75a1836231 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] 10.222.0.20 "GET /compute/v2.1/servers/30391772-c0aa-468b-a414-c40c716a2481" status: 200 len: 1358 microversion: 2.1 time: 0.253070 Jul 01 04:07:23.212008 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 170/334] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:07:22 2022] GET /compute/v2.1/servers/30391772-c0aa-468b-a414-c40c716a2481 => generated 1358 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:07:23.356675 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-b9b023a9-c97a-49d7-803c-f2384301fe00 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:07:23.374669 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-b9b023a9-c97a-49d7-803c-f2384301fe00 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:07:23.374669 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-b9b023a9-c97a-49d7-803c-f2384301fe00 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:07:23.374669 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-b9b023a9-c97a-49d7-803c-f2384301fe00 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] 10.222.0.20 "GET /compute/v2.1/servers/b904f233-887c-4c96-a2d2-f7f415ad852f" status: 200 len: 1752 microversion: 2.20 time: 0.294508 Jul 01 04:07:23.375058 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 165/335] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Jul 1 04:07:23 2022] GET /compute/v2.1/servers/b904f233-887c-4c96-a2d2-f7f415ad852f => generated 1752 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 04:07:23.903048 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-7eff1a39-3149-4465-b1e5-2f8c169d003c tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:07:23.904210 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-7eff1a39-3149-4465-b1e5-2f8c169d003c tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] [instance: 16079191-5fa2-4add-8134-bf7d18446a6a] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:07:23.910289 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG dbcounter [-] [118712] Writing DB stats nova_cell0:SELECT=2 {{(pid=118712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:07:23.911482 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG dbcounter [-] [118712] Writing DB stats nova_api:SELECT=82 {{(pid=118712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:07:23.913233 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-7eff1a39-3149-4465-b1e5-2f8c169d003c tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:07:23.914094 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-7eff1a39-3149-4465-b1e5-2f8c169d003c tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:07:23.915098 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-7eff1a39-3149-4465-b1e5-2f8c169d003c tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:07:23.915741 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-7eff1a39-3149-4465-b1e5-2f8c169d003c tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:07:24.108305 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-7eff1a39-3149-4465-b1e5-2f8c169d003c tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021817b0eef94fc2a19d90c511ec9298', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87ca5d9f50847d6ab501ca3a51ab37c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:07:24.116911 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-7eff1a39-3149-4465-b1e5-2f8c169d003c tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] 10.222.0.20 "GET /compute/v2.1/servers/16079191-5fa2-4add-8134-bf7d18446a6a" status: 200 len: 1319 microversion: 2.1 time: 0.218520 Jul 01 04:07:24.117478 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 171/336] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:07:23 2022] GET /compute/v2.1/servers/16079191-5fa2-4add-8134-bf7d18446a6a => generated 1319 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:07:24.238023 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-e63517b5-7148-400a-af2f-d1f97f8a96b5 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:07:24.238688 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-e63517b5-7148-400a-af2f-d1f97f8a96b5 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] [instance: 30391772-c0aa-468b-a414-c40c716a2481] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:07:24.249783 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-e63517b5-7148-400a-af2f-d1f97f8a96b5 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:07:24.250240 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-e63517b5-7148-400a-af2f-d1f97f8a96b5 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:07:24.251101 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-e63517b5-7148-400a-af2f-d1f97f8a96b5 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:07:24.251514 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-e63517b5-7148-400a-af2f-d1f97f8a96b5 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:07:24.390228 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-3ff095a1-44f4-478a-90fc-67c35fe2c04b tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:07:24.390983 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-3ff095a1-44f4-478a-90fc-67c35fe2c04b tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] [instance: b904f233-887c-4c96-a2d2-f7f415ad852f] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:07:24.397293 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-3ff095a1-44f4-478a-90fc-67c35fe2c04b tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:07:24.397743 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-3ff095a1-44f4-478a-90fc-67c35fe2c04b tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:07:24.398535 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-3ff095a1-44f4-478a-90fc-67c35fe2c04b tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:07:24.398967 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-3ff095a1-44f4-478a-90fc-67c35fe2c04b tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:07:24.434650 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-e63517b5-7148-400a-af2f-d1f97f8a96b5 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abc2e04754884398afc999d423e2a711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2940ca71c4b24b5facc194b61d748a11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:07:24.446795 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-e63517b5-7148-400a-af2f-d1f97f8a96b5 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] 10.222.0.20 "GET /compute/v2.1/servers/30391772-c0aa-468b-a414-c40c716a2481" status: 200 len: 1358 microversion: 2.1 time: 0.213099 Jul 01 04:07:24.447426 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 166/337] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:07:24 2022] GET /compute/v2.1/servers/30391772-c0aa-468b-a414-c40c716a2481 => generated 1358 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:07:24.580621 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-3ff095a1-44f4-478a-90fc-67c35fe2c04b tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:07:24.591624 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-3ff095a1-44f4-478a-90fc-67c35fe2c04b tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:07:24.593529 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-3ff095a1-44f4-478a-90fc-67c35fe2c04b tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:07:24.595085 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-3ff095a1-44f4-478a-90fc-67c35fe2c04b tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] 10.222.0.20 "GET /compute/v2.1/servers/b904f233-887c-4c96-a2d2-f7f415ad852f" status: 200 len: 1752 microversion: 2.20 time: 0.208790 Jul 01 04:07:24.596989 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 172/338] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Jul 1 04:07:24 2022] GET /compute/v2.1/servers/b904f233-887c-4c96-a2d2-f7f415ad852f => generated 1752 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 01 04:07:25.134309 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-a26054e9-b07c-45c1-be3f-799c21d7f154 tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:07:25.135013 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-a26054e9-b07c-45c1-be3f-799c21d7f154 tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] [instance: 16079191-5fa2-4add-8134-bf7d18446a6a] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:07:25.141838 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-a26054e9-b07c-45c1-be3f-799c21d7f154 tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:07:25.142286 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-a26054e9-b07c-45c1-be3f-799c21d7f154 tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:07:25.143087 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-a26054e9-b07c-45c1-be3f-799c21d7f154 tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:07:25.143575 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-a26054e9-b07c-45c1-be3f-799c21d7f154 tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:07:25.333623 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-a26054e9-b07c-45c1-be3f-799c21d7f154 tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021817b0eef94fc2a19d90c511ec9298', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87ca5d9f50847d6ab501ca3a51ab37c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:07:25.343467 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-a26054e9-b07c-45c1-be3f-799c21d7f154 tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] 10.222.0.20 "GET /compute/v2.1/servers/16079191-5fa2-4add-8134-bf7d18446a6a" status: 200 len: 1319 microversion: 2.1 time: 0.213118 Jul 01 04:07:25.344339 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 167/339] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:07:25 2022] GET /compute/v2.1/servers/16079191-5fa2-4add-8134-bf7d18446a6a => generated 1319 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:07:25.465947 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-8aa0902f-2925-40cb-8b4a-c88857139f52 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:07:25.466790 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-8aa0902f-2925-40cb-8b4a-c88857139f52 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] [instance: 30391772-c0aa-468b-a414-c40c716a2481] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:07:25.473309 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-8aa0902f-2925-40cb-8b4a-c88857139f52 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:07:25.473768 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-8aa0902f-2925-40cb-8b4a-c88857139f52 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:07:25.474544 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-8aa0902f-2925-40cb-8b4a-c88857139f52 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:07:25.474987 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-8aa0902f-2925-40cb-8b4a-c88857139f52 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:07:25.624518 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-fc93b961-fbba-4e93-b242-0980caf460dd tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:07:25.626016 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-fc93b961-fbba-4e93-b242-0980caf460dd tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] [instance: b904f233-887c-4c96-a2d2-f7f415ad852f] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:07:25.634198 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-fc93b961-fbba-4e93-b242-0980caf460dd tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:07:25.634983 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-fc93b961-fbba-4e93-b242-0980caf460dd tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:07:25.636954 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-fc93b961-fbba-4e93-b242-0980caf460dd tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:07:25.637913 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-fc93b961-fbba-4e93-b242-0980caf460dd tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:07:25.664832 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-8aa0902f-2925-40cb-8b4a-c88857139f52 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abc2e04754884398afc999d423e2a711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2940ca71c4b24b5facc194b61d748a11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:07:25.675049 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-8aa0902f-2925-40cb-8b4a-c88857139f52 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] 10.222.0.20 "GET /compute/v2.1/servers/30391772-c0aa-468b-a414-c40c716a2481" status: 200 len: 1358 microversion: 2.1 time: 0.213131 Jul 01 04:07:25.676535 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 173/340] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:07:25 2022] GET /compute/v2.1/servers/30391772-c0aa-468b-a414-c40c716a2481 => generated 1358 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:07:25.836194 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-fc93b961-fbba-4e93-b242-0980caf460dd tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:07:25.846197 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-fc93b961-fbba-4e93-b242-0980caf460dd tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:07:25.848094 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-fc93b961-fbba-4e93-b242-0980caf460dd tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:07:25.849542 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-fc93b961-fbba-4e93-b242-0980caf460dd tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] 10.222.0.20 "GET /compute/v2.1/servers/b904f233-887c-4c96-a2d2-f7f415ad852f" status: 200 len: 1752 microversion: 2.20 time: 0.230885 Jul 01 04:07:25.866284 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 168/341] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Jul 1 04:07:25 2022] GET /compute/v2.1/servers/b904f233-887c-4c96-a2d2-f7f415ad852f => generated 1752 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 04:07:26.367868 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-d898331a-038c-41ff-9c7f-336a93bbb915 tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:07:26.369276 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-d898331a-038c-41ff-9c7f-336a93bbb915 tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] [instance: 16079191-5fa2-4add-8134-bf7d18446a6a] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:07:26.376921 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-d898331a-038c-41ff-9c7f-336a93bbb915 tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:07:26.377964 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-d898331a-038c-41ff-9c7f-336a93bbb915 tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:07:26.379052 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-d898331a-038c-41ff-9c7f-336a93bbb915 tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:07:26.379786 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-d898331a-038c-41ff-9c7f-336a93bbb915 tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:07:26.639105 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-d898331a-038c-41ff-9c7f-336a93bbb915 tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021817b0eef94fc2a19d90c511ec9298', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87ca5d9f50847d6ab501ca3a51ab37c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:07:26.648574 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-d898331a-038c-41ff-9c7f-336a93bbb915 tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] 10.222.0.20 "GET /compute/v2.1/servers/16079191-5fa2-4add-8134-bf7d18446a6a" status: 200 len: 1319 microversion: 2.1 time: 0.287431 Jul 01 04:07:26.649490 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 174/342] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:07:26 2022] GET /compute/v2.1/servers/16079191-5fa2-4add-8134-bf7d18446a6a => generated 1319 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:07:26.706530 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-ba6dba6f-ba3a-4d67-9cca-0930e25f1f1a tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:07:26.707927 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-ba6dba6f-ba3a-4d67-9cca-0930e25f1f1a tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] [instance: 30391772-c0aa-468b-a414-c40c716a2481] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:07:26.717285 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-ba6dba6f-ba3a-4d67-9cca-0930e25f1f1a tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:07:26.717984 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-ba6dba6f-ba3a-4d67-9cca-0930e25f1f1a tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:07:26.718865 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-ba6dba6f-ba3a-4d67-9cca-0930e25f1f1a tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:07:26.719291 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-ba6dba6f-ba3a-4d67-9cca-0930e25f1f1a tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:07:26.874454 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-ef8cef24-1d57-46d7-a166-d49df64f9db4 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:07:26.875110 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-ef8cef24-1d57-46d7-a166-d49df64f9db4 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] [instance: b904f233-887c-4c96-a2d2-f7f415ad852f] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:07:26.881572 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-ef8cef24-1d57-46d7-a166-d49df64f9db4 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:07:26.882030 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-ef8cef24-1d57-46d7-a166-d49df64f9db4 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:07:26.882823 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-ef8cef24-1d57-46d7-a166-d49df64f9db4 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:07:26.896017 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-ef8cef24-1d57-46d7-a166-d49df64f9db4 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:07:26.970113 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-ba6dba6f-ba3a-4d67-9cca-0930e25f1f1a tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abc2e04754884398afc999d423e2a711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2940ca71c4b24b5facc194b61d748a11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:07:26.982872 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-ba6dba6f-ba3a-4d67-9cca-0930e25f1f1a tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] 10.222.0.20 "GET /compute/v2.1/servers/30391772-c0aa-468b-a414-c40c716a2481" status: 200 len: 1358 microversion: 2.1 time: 0.280848 Jul 01 04:07:26.984530 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 169/343] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:07:26 2022] GET /compute/v2.1/servers/30391772-c0aa-468b-a414-c40c716a2481 => generated 1358 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:07:27.132672 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-ef8cef24-1d57-46d7-a166-d49df64f9db4 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:07:27.159049 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-ef8cef24-1d57-46d7-a166-d49df64f9db4 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:07:27.161467 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-ef8cef24-1d57-46d7-a166-d49df64f9db4 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:07:27.163674 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-ef8cef24-1d57-46d7-a166-d49df64f9db4 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] 10.222.0.20 "GET /compute/v2.1/servers/b904f233-887c-4c96-a2d2-f7f415ad852f" status: 200 len: 1752 microversion: 2.20 time: 0.293119 Jul 01 04:07:27.164444 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 175/344] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Jul 1 04:07:26 2022] GET /compute/v2.1/servers/b904f233-887c-4c96-a2d2-f7f415ad852f => generated 1752 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 01 04:07:27.666266 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-6fc1d4ca-012d-487e-a5ce-16024fc8f4f4 tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:07:27.667461 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-6fc1d4ca-012d-487e-a5ce-16024fc8f4f4 tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] [instance: 16079191-5fa2-4add-8134-bf7d18446a6a] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:07:27.674691 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-6fc1d4ca-012d-487e-a5ce-16024fc8f4f4 tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:07:27.675348 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-6fc1d4ca-012d-487e-a5ce-16024fc8f4f4 tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:07:27.676319 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-6fc1d4ca-012d-487e-a5ce-16024fc8f4f4 tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:07:27.676851 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-6fc1d4ca-012d-487e-a5ce-16024fc8f4f4 tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:07:27.933962 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-6fc1d4ca-012d-487e-a5ce-16024fc8f4f4 tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021817b0eef94fc2a19d90c511ec9298', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87ca5d9f50847d6ab501ca3a51ab37c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:07:27.943806 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-6fc1d4ca-012d-487e-a5ce-16024fc8f4f4 tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] 10.222.0.20 "GET /compute/v2.1/servers/16079191-5fa2-4add-8134-bf7d18446a6a" status: 200 len: 1319 microversion: 2.1 time: 0.281260 Jul 01 04:07:27.945540 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 170/345] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:07:27 2022] GET /compute/v2.1/servers/16079191-5fa2-4add-8134-bf7d18446a6a => generated 1319 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 04:07:28.005883 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-62a9064e-07c7-4a75-b2a2-e03dffd00858 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:07:28.007479 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-62a9064e-07c7-4a75-b2a2-e03dffd00858 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] [instance: 30391772-c0aa-468b-a414-c40c716a2481] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:07:28.040036 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-62a9064e-07c7-4a75-b2a2-e03dffd00858 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:07:28.043367 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-62a9064e-07c7-4a75-b2a2-e03dffd00858 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:07:28.043753 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-62a9064e-07c7-4a75-b2a2-e03dffd00858 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:07:28.044939 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-62a9064e-07c7-4a75-b2a2-e03dffd00858 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:07:28.185487 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-85c03bc8-f71b-4bce-82c7-e6049b1f1eae tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:07:28.190847 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-85c03bc8-f71b-4bce-82c7-e6049b1f1eae tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] [instance: b904f233-887c-4c96-a2d2-f7f415ad852f] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:07:28.195651 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-85c03bc8-f71b-4bce-82c7-e6049b1f1eae tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:07:28.196418 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-85c03bc8-f71b-4bce-82c7-e6049b1f1eae tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:07:28.197437 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-85c03bc8-f71b-4bce-82c7-e6049b1f1eae tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:07:28.198257 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-85c03bc8-f71b-4bce-82c7-e6049b1f1eae tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:07:28.259560 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-62a9064e-07c7-4a75-b2a2-e03dffd00858 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abc2e04754884398afc999d423e2a711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2940ca71c4b24b5facc194b61d748a11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:07:28.274588 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-62a9064e-07c7-4a75-b2a2-e03dffd00858 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] 10.222.0.20 "GET /compute/v2.1/servers/30391772-c0aa-468b-a414-c40c716a2481" status: 200 len: 1358 microversion: 2.1 time: 0.272109 Jul 01 04:07:28.274588 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 176/346] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:07:27 2022] GET /compute/v2.1/servers/30391772-c0aa-468b-a414-c40c716a2481 => generated 1358 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:07:28.539113 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-85c03bc8-f71b-4bce-82c7-e6049b1f1eae tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:07:28.551873 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-85c03bc8-f71b-4bce-82c7-e6049b1f1eae tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:07:28.554176 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-85c03bc8-f71b-4bce-82c7-e6049b1f1eae tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:07:28.556250 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-85c03bc8-f71b-4bce-82c7-e6049b1f1eae tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] 10.222.0.20 "GET /compute/v2.1/servers/b904f233-887c-4c96-a2d2-f7f415ad852f" status: 200 len: 1752 microversion: 2.20 time: 0.376968 Jul 01 04:07:28.557658 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 171/347] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Jul 1 04:07:28 2022] GET /compute/v2.1/servers/b904f233-887c-4c96-a2d2-f7f415ad852f => generated 1752 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 04:07:28.976764 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-6fcb1278-8067-4034-a354-feb631bf6d22 tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:07:28.977298 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-6fcb1278-8067-4034-a354-feb631bf6d22 tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] [instance: 16079191-5fa2-4add-8134-bf7d18446a6a] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:07:28.985964 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-6fcb1278-8067-4034-a354-feb631bf6d22 tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:07:28.987181 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-6fcb1278-8067-4034-a354-feb631bf6d22 tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:07:28.988960 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-6fcb1278-8067-4034-a354-feb631bf6d22 tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:07:28.989963 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-6fcb1278-8067-4034-a354-feb631bf6d22 tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:07:29.297390 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-17d9be06-62e3-4e21-98e5-42c7ea64960d tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:07:29.297390 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-17d9be06-62e3-4e21-98e5-42c7ea64960d tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] [instance: 30391772-c0aa-468b-a414-c40c716a2481] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:07:29.307371 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-17d9be06-62e3-4e21-98e5-42c7ea64960d tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:07:29.308599 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-17d9be06-62e3-4e21-98e5-42c7ea64960d tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:07:29.326376 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-17d9be06-62e3-4e21-98e5-42c7ea64960d tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:07:29.327411 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-17d9be06-62e3-4e21-98e5-42c7ea64960d tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:07:29.378690 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-6fcb1278-8067-4034-a354-feb631bf6d22 tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021817b0eef94fc2a19d90c511ec9298', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87ca5d9f50847d6ab501ca3a51ab37c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:07:29.410220 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-6fcb1278-8067-4034-a354-feb631bf6d22 tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] 10.222.0.20 "GET /compute/v2.1/servers/16079191-5fa2-4add-8134-bf7d18446a6a" status: 200 len: 1319 microversion: 2.1 time: 0.437092 Jul 01 04:07:29.416625 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 177/348] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:07:28 2022] GET /compute/v2.1/servers/16079191-5fa2-4add-8134-bf7d18446a6a => generated 1319 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 04:07:29.596727 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-112c82d6-f32e-4a54-bfb9-6d4dfa7a144e tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:07:29.599606 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-112c82d6-f32e-4a54-bfb9-6d4dfa7a144e tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] [instance: b904f233-887c-4c96-a2d2-f7f415ad852f] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:07:29.646134 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-112c82d6-f32e-4a54-bfb9-6d4dfa7a144e tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:07:29.656840 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-112c82d6-f32e-4a54-bfb9-6d4dfa7a144e tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:07:29.656840 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-112c82d6-f32e-4a54-bfb9-6d4dfa7a144e tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:07:29.656840 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-112c82d6-f32e-4a54-bfb9-6d4dfa7a144e tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:07:29.694375 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-17d9be06-62e3-4e21-98e5-42c7ea64960d tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abc2e04754884398afc999d423e2a711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2940ca71c4b24b5facc194b61d748a11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:07:29.738965 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-17d9be06-62e3-4e21-98e5-42c7ea64960d tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] 10.222.0.20 "GET /compute/v2.1/servers/30391772-c0aa-468b-a414-c40c716a2481" status: 200 len: 1358 microversion: 2.1 time: 0.439287 Jul 01 04:07:29.760636 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 172/349] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:07:29 2022] GET /compute/v2.1/servers/30391772-c0aa-468b-a414-c40c716a2481 => generated 1358 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 04:07:30.048437 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-112c82d6-f32e-4a54-bfb9-6d4dfa7a144e tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:07:30.077427 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-112c82d6-f32e-4a54-bfb9-6d4dfa7a144e tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:07:30.083663 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-112c82d6-f32e-4a54-bfb9-6d4dfa7a144e tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:07:30.089999 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-112c82d6-f32e-4a54-bfb9-6d4dfa7a144e tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] 10.222.0.20 "GET /compute/v2.1/servers/b904f233-887c-4c96-a2d2-f7f415ad852f" status: 200 len: 1752 microversion: 2.20 time: 0.497759 Jul 01 04:07:30.095049 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 178/350] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Jul 1 04:07:29 2022] GET /compute/v2.1/servers/b904f233-887c-4c96-a2d2-f7f415ad852f => generated 1752 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 01 04:07:30.452865 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-72344755-cdd1-4cb1-9bdc-38cf7c598697 tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:07:30.456713 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-72344755-cdd1-4cb1-9bdc-38cf7c598697 tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] [instance: 16079191-5fa2-4add-8134-bf7d18446a6a] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:07:30.505734 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-72344755-cdd1-4cb1-9bdc-38cf7c598697 tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:07:30.506908 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-72344755-cdd1-4cb1-9bdc-38cf7c598697 tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:07:30.510424 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-72344755-cdd1-4cb1-9bdc-38cf7c598697 tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:07:30.515332 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-72344755-cdd1-4cb1-9bdc-38cf7c598697 tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:07:30.778363 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-2800819e-8b1f-4510-9277-2b33d0ecc0b2 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:07:30.778363 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-2800819e-8b1f-4510-9277-2b33d0ecc0b2 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] [instance: 30391772-c0aa-468b-a414-c40c716a2481] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:07:30.787695 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-2800819e-8b1f-4510-9277-2b33d0ecc0b2 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:07:30.789060 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-2800819e-8b1f-4510-9277-2b33d0ecc0b2 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:07:30.790942 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-2800819e-8b1f-4510-9277-2b33d0ecc0b2 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:07:30.792165 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-2800819e-8b1f-4510-9277-2b33d0ecc0b2 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:07:30.903962 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-72344755-cdd1-4cb1-9bdc-38cf7c598697 tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021817b0eef94fc2a19d90c511ec9298', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87ca5d9f50847d6ab501ca3a51ab37c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:07:30.914818 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-72344755-cdd1-4cb1-9bdc-38cf7c598697 tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] 10.222.0.20 "GET /compute/v2.1/servers/16079191-5fa2-4add-8134-bf7d18446a6a" status: 200 len: 1319 microversion: 2.1 time: 0.483968 Jul 01 04:07:30.919842 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 173/351] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:07:30 2022] GET /compute/v2.1/servers/16079191-5fa2-4add-8134-bf7d18446a6a => generated 1319 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:07:31.140566 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-10d07420-8af4-4328-bdb2-f01c9dc6376e tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:07:31.142441 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-10d07420-8af4-4328-bdb2-f01c9dc6376e tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] [instance: b904f233-887c-4c96-a2d2-f7f415ad852f] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:07:31.158551 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-10d07420-8af4-4328-bdb2-f01c9dc6376e tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:07:31.160309 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-10d07420-8af4-4328-bdb2-f01c9dc6376e tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:07:31.163034 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-10d07420-8af4-4328-bdb2-f01c9dc6376e tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:07:31.164338 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-10d07420-8af4-4328-bdb2-f01c9dc6376e tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:07:31.734465 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-2800819e-8b1f-4510-9277-2b33d0ecc0b2 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abc2e04754884398afc999d423e2a711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2940ca71c4b24b5facc194b61d748a11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:07:31.745526 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-2800819e-8b1f-4510-9277-2b33d0ecc0b2 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] 10.222.0.20 "GET /compute/v2.1/servers/30391772-c0aa-468b-a414-c40c716a2481" status: 200 len: 1358 microversion: 2.1 time: 0.982011 Jul 01 04:07:31.747914 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 179/352] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:07:30 2022] GET /compute/v2.1/servers/30391772-c0aa-468b-a414-c40c716a2481 => generated 1358 bytes in 985 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:07:31.885952 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-10d07420-8af4-4328-bdb2-f01c9dc6376e tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:07:31.897630 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-10d07420-8af4-4328-bdb2-f01c9dc6376e tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:07:31.899471 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-10d07420-8af4-4328-bdb2-f01c9dc6376e tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:07:31.900743 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-10d07420-8af4-4328-bdb2-f01c9dc6376e tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] 10.222.0.20 "GET /compute/v2.1/servers/b904f233-887c-4c96-a2d2-f7f415ad852f" status: 200 len: 1752 microversion: 2.20 time: 0.769800 Jul 01 04:07:31.901319 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 174/353] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Jul 1 04:07:31 2022] GET /compute/v2.1/servers/b904f233-887c-4c96-a2d2-f7f415ad852f => generated 1752 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 01 04:07:31.945976 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-b21dfde1-958b-4c85-a586-a76d8f84fe47 tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:07:31.947249 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-b21dfde1-958b-4c85-a586-a76d8f84fe47 tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] [instance: 16079191-5fa2-4add-8134-bf7d18446a6a] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:07:31.960252 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-b21dfde1-958b-4c85-a586-a76d8f84fe47 tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:07:31.961608 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-b21dfde1-958b-4c85-a586-a76d8f84fe47 tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:07:31.963535 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-b21dfde1-958b-4c85-a586-a76d8f84fe47 tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:07:31.964386 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-b21dfde1-958b-4c85-a586-a76d8f84fe47 tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:07:32.184368 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [req-3bb16aea-2b39-437c-a20f-79bd62e2f09f req-a6e431c9-2319-447c-8bd2-47400a794a13 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "30391772-c0aa-468b-a414-c40c716a2481", "tag": "0602970e-ed10-4c75-92d7-cd153851994b"}]} {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 04:07:32.203038 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [req-3bb16aea-2b39-437c-a20f-79bd62e2f09f req-a6e431c9-2319-447c-8bd2-47400a794a13 service nova] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:07:32.203959 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [req-3bb16aea-2b39-437c-a20f-79bd62e2f09f req-a6e431c9-2319-447c-8bd2-47400a794a13 service nova] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:07:32.220962 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.compute.server_external_events [req-3bb16aea-2b39-437c-a20f-79bd62e2f09f req-a6e431c9-2319-447c-8bd2-47400a794a13 service nova] Creating event network-changed:0602970e-ed10-4c75-92d7-cd153851994b for instance 30391772-c0aa-468b-a414-c40c716a2481 on hv-cinder-84684 Jul 01 04:07:32.228261 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [req-3bb16aea-2b39-437c-a20f-79bd62e2f09f req-a6e431c9-2319-447c-8bd2-47400a794a13 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054528 Jul 01 04:07:32.229600 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 175/354] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Jul 1 04:07:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 01 04:07:32.536203 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-b21dfde1-958b-4c85-a586-a76d8f84fe47 tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021817b0eef94fc2a19d90c511ec9298', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87ca5d9f50847d6ab501ca3a51ab37c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:07:32.565893 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-b21dfde1-958b-4c85-a586-a76d8f84fe47 tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] 10.222.0.20 "GET /compute/v2.1/servers/16079191-5fa2-4add-8134-bf7d18446a6a" status: 200 len: 1319 microversion: 2.1 time: 0.630980 Jul 01 04:07:32.580550 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 180/355] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:07:31 2022] GET /compute/v2.1/servers/16079191-5fa2-4add-8134-bf7d18446a6a => generated 1319 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:07:32.789027 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-02e9f777-870f-47ea-9fb7-5ebe938f4e00 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:07:32.790988 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-02e9f777-870f-47ea-9fb7-5ebe938f4e00 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] [instance: 30391772-c0aa-468b-a414-c40c716a2481] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:07:32.816940 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-02e9f777-870f-47ea-9fb7-5ebe938f4e00 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:07:32.819731 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-02e9f777-870f-47ea-9fb7-5ebe938f4e00 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:07:32.821837 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-02e9f777-870f-47ea-9fb7-5ebe938f4e00 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:07:32.822835 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-02e9f777-870f-47ea-9fb7-5ebe938f4e00 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:07:32.923868 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-e2d0497c-d42f-4d81-8e02-a9d9493d601f tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:07:32.925216 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-e2d0497c-d42f-4d81-8e02-a9d9493d601f tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] [instance: b904f233-887c-4c96-a2d2-f7f415ad852f] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:07:32.932028 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-e2d0497c-d42f-4d81-8e02-a9d9493d601f tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:07:32.936287 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-e2d0497c-d42f-4d81-8e02-a9d9493d601f tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:07:32.936287 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-e2d0497c-d42f-4d81-8e02-a9d9493d601f tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:07:32.936287 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-e2d0497c-d42f-4d81-8e02-a9d9493d601f tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:07:33.229717 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-e2d0497c-d42f-4d81-8e02-a9d9493d601f tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:07:33.245029 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-e2d0497c-d42f-4d81-8e02-a9d9493d601f tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:07:33.247660 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-e2d0497c-d42f-4d81-8e02-a9d9493d601f tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:07:33.250767 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-e2d0497c-d42f-4d81-8e02-a9d9493d601f tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] 10.222.0.20 "GET /compute/v2.1/servers/b904f233-887c-4c96-a2d2-f7f415ad852f" status: 200 len: 1808 microversion: 2.20 time: 0.333536 Jul 01 04:07:33.252007 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 181/356] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Jul 1 04:07:32 2022] GET /compute/v2.1/servers/b904f233-887c-4c96-a2d2-f7f415ad852f => generated 1808 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 04:07:33.311919 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-02e9f777-870f-47ea-9fb7-5ebe938f4e00 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abc2e04754884398afc999d423e2a711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2940ca71c4b24b5facc194b61d748a11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:07:33.320843 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-02e9f777-870f-47ea-9fb7-5ebe938f4e00 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] 10.222.0.20 "GET /compute/v2.1/servers/30391772-c0aa-468b-a414-c40c716a2481" status: 200 len: 1358 microversion: 2.1 time: 0.551088 Jul 01 04:07:33.321450 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 176/357] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:07:32 2022] GET /compute/v2.1/servers/30391772-c0aa-468b-a414-c40c716a2481 => generated 1358 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:07:33.588551 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-e1c1abe7-0ad3-4584-ab83-3ee4fe02b0a7 tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:07:33.590314 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-e1c1abe7-0ad3-4584-ab83-3ee4fe02b0a7 tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] [instance: 16079191-5fa2-4add-8134-bf7d18446a6a] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:07:33.601792 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-e1c1abe7-0ad3-4584-ab83-3ee4fe02b0a7 tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:07:33.602745 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-e1c1abe7-0ad3-4584-ab83-3ee4fe02b0a7 tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:07:33.604279 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-e1c1abe7-0ad3-4584-ab83-3ee4fe02b0a7 tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:07:33.605712 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-e1c1abe7-0ad3-4584-ab83-3ee4fe02b0a7 tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:07:33.799050 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-e1c1abe7-0ad3-4584-ab83-3ee4fe02b0a7 tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021817b0eef94fc2a19d90c511ec9298', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87ca5d9f50847d6ab501ca3a51ab37c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:07:33.808049 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-e1c1abe7-0ad3-4584-ab83-3ee4fe02b0a7 tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] 10.222.0.20 "GET /compute/v2.1/servers/16079191-5fa2-4add-8134-bf7d18446a6a" status: 200 len: 1319 microversion: 2.1 time: 0.225489 Jul 01 04:07:33.808642 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 182/358] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:07:33 2022] GET /compute/v2.1/servers/16079191-5fa2-4add-8134-bf7d18446a6a => generated 1319 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 04:07:34.273056 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-a2676c52-1603-4143-95e9-c05533ad34ab tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:07:34.273709 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-a2676c52-1603-4143-95e9-c05533ad34ab tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] [instance: b904f233-887c-4c96-a2d2-f7f415ad852f] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:07:34.281694 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-a2676c52-1603-4143-95e9-c05533ad34ab tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:07:34.282146 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-a2676c52-1603-4143-95e9-c05533ad34ab tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:07:34.282950 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-a2676c52-1603-4143-95e9-c05533ad34ab tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:07:34.283470 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-a2676c52-1603-4143-95e9-c05533ad34ab tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:07:34.343680 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-f066f0d8-7329-42ef-a181-63df525d2ab7 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:07:34.345189 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-f066f0d8-7329-42ef-a181-63df525d2ab7 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] [instance: 30391772-c0aa-468b-a414-c40c716a2481] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:07:34.351902 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-f066f0d8-7329-42ef-a181-63df525d2ab7 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:07:34.352342 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-f066f0d8-7329-42ef-a181-63df525d2ab7 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:07:34.353388 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-f066f0d8-7329-42ef-a181-63df525d2ab7 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:07:34.353967 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-f066f0d8-7329-42ef-a181-63df525d2ab7 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:07:34.587366 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-f066f0d8-7329-42ef-a181-63df525d2ab7 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abc2e04754884398afc999d423e2a711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2940ca71c4b24b5facc194b61d748a11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:07:34.596005 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-f066f0d8-7329-42ef-a181-63df525d2ab7 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] 10.222.0.20 "GET /compute/v2.1/servers/30391772-c0aa-468b-a414-c40c716a2481" status: 200 len: 1358 microversion: 2.1 time: 0.257037 Jul 01 04:07:34.606455 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 183/359] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:07:34 2022] GET /compute/v2.1/servers/30391772-c0aa-468b-a414-c40c716a2481 => generated 1358 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 04:07:34.639423 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-a2676c52-1603-4143-95e9-c05533ad34ab tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:07:34.650243 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-a2676c52-1603-4143-95e9-c05533ad34ab tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:07:34.652629 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-a2676c52-1603-4143-95e9-c05533ad34ab tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:07:34.653804 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-a2676c52-1603-4143-95e9-c05533ad34ab tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] 10.222.0.20 "GET /compute/v2.1/servers/b904f233-887c-4c96-a2d2-f7f415ad852f" status: 200 len: 1808 microversion: 2.20 time: 0.384690 Jul 01 04:07:34.654405 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 177/360] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Jul 1 04:07:34 2022] GET /compute/v2.1/servers/b904f233-887c-4c96-a2d2-f7f415ad852f => generated 1808 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 04:07:34.827397 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-4d5f242e-04c3-4ea5-b531-70211b6e7966 tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:07:34.828442 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-4d5f242e-04c3-4ea5-b531-70211b6e7966 tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] [instance: 16079191-5fa2-4add-8134-bf7d18446a6a] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:07:34.836155 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-4d5f242e-04c3-4ea5-b531-70211b6e7966 tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:07:34.836827 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-4d5f242e-04c3-4ea5-b531-70211b6e7966 tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:07:34.837835 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-4d5f242e-04c3-4ea5-b531-70211b6e7966 tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:07:34.838439 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-4d5f242e-04c3-4ea5-b531-70211b6e7966 tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:07:35.056413 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-4d5f242e-04c3-4ea5-b531-70211b6e7966 tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021817b0eef94fc2a19d90c511ec9298', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87ca5d9f50847d6ab501ca3a51ab37c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:07:35.060741 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG dbcounter [-] [118712] Writing DB stats nova_cell1:SELECT=100 {{(pid=118712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:07:35.069208 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-4d5f242e-04c3-4ea5-b531-70211b6e7966 tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] 10.222.0.20 "GET /compute/v2.1/servers/16079191-5fa2-4add-8134-bf7d18446a6a" status: 200 len: 1319 microversion: 2.1 time: 0.246877 Jul 01 04:07:35.070342 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 184/361] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:07:34 2022] GET /compute/v2.1/servers/16079191-5fa2-4add-8134-bf7d18446a6a => generated 1319 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 04:07:35.613941 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-010eab97-9806-437d-8000-d82b05988a13 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:07:35.614911 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-010eab97-9806-437d-8000-d82b05988a13 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] [instance: 30391772-c0aa-468b-a414-c40c716a2481] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:07:35.629907 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-010eab97-9806-437d-8000-d82b05988a13 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:07:35.631372 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-010eab97-9806-437d-8000-d82b05988a13 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:07:35.632558 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-010eab97-9806-437d-8000-d82b05988a13 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:07:35.633019 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-010eab97-9806-437d-8000-d82b05988a13 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:07:35.680163 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-5e5b6626-a4b4-4dd2-96a5-8624a6488a24 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:07:35.681306 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-5e5b6626-a4b4-4dd2-96a5-8624a6488a24 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] [instance: b904f233-887c-4c96-a2d2-f7f415ad852f] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:07:35.697750 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-5e5b6626-a4b4-4dd2-96a5-8624a6488a24 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:07:35.699263 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-5e5b6626-a4b4-4dd2-96a5-8624a6488a24 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:07:35.701063 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-5e5b6626-a4b4-4dd2-96a5-8624a6488a24 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:07:35.702404 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-5e5b6626-a4b4-4dd2-96a5-8624a6488a24 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:07:35.860266 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-010eab97-9806-437d-8000-d82b05988a13 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abc2e04754884398afc999d423e2a711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2940ca71c4b24b5facc194b61d748a11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:07:35.888895 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-010eab97-9806-437d-8000-d82b05988a13 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] 10.222.0.20 "GET /compute/v2.1/servers/30391772-c0aa-468b-a414-c40c716a2481" status: 200 len: 1358 microversion: 2.1 time: 0.278565 Jul 01 04:07:35.891574 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 178/362] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:07:35 2022] GET /compute/v2.1/servers/30391772-c0aa-468b-a414-c40c716a2481 => generated 1358 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 04:07:36.092040 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-b3cac855-6d5c-4a4a-9d29-877e140a3192 tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:07:36.093006 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-b3cac855-6d5c-4a4a-9d29-877e140a3192 tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] [instance: 16079191-5fa2-4add-8134-bf7d18446a6a] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:07:36.099144 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-5e5b6626-a4b4-4dd2-96a5-8624a6488a24 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:07:36.101317 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-b3cac855-6d5c-4a4a-9d29-877e140a3192 tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:07:36.102906 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-b3cac855-6d5c-4a4a-9d29-877e140a3192 tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:07:36.104246 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-b3cac855-6d5c-4a4a-9d29-877e140a3192 tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:07:36.104521 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-b3cac855-6d5c-4a4a-9d29-877e140a3192 tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:07:36.113905 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-5e5b6626-a4b4-4dd2-96a5-8624a6488a24 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:07:36.115190 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-5e5b6626-a4b4-4dd2-96a5-8624a6488a24 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:07:36.116708 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-5e5b6626-a4b4-4dd2-96a5-8624a6488a24 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] 10.222.0.20 "GET /compute/v2.1/servers/b904f233-887c-4c96-a2d2-f7f415ad852f" status: 200 len: 1808 microversion: 2.20 time: 0.446769 Jul 01 04:07:36.117574 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 185/363] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Jul 1 04:07:35 2022] GET /compute/v2.1/servers/b904f233-887c-4c96-a2d2-f7f415ad852f => generated 1808 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 01 04:07:36.261180 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-b3cac855-6d5c-4a4a-9d29-877e140a3192 tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021817b0eef94fc2a19d90c511ec9298', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87ca5d9f50847d6ab501ca3a51ab37c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:07:36.270321 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-b3cac855-6d5c-4a4a-9d29-877e140a3192 tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] 10.222.0.20 "GET /compute/v2.1/servers/16079191-5fa2-4add-8134-bf7d18446a6a" status: 200 len: 1319 microversion: 2.1 time: 0.183544 Jul 01 04:07:36.271167 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 179/364] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:07:36 2022] GET /compute/v2.1/servers/16079191-5fa2-4add-8134-bf7d18446a6a => generated 1319 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:07:36.909025 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-f7a208b7-2f03-4cf6-a952-9a6ed1d72798 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:07:36.910346 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-f7a208b7-2f03-4cf6-a952-9a6ed1d72798 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] [instance: 30391772-c0aa-468b-a414-c40c716a2481] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:07:36.922818 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-f7a208b7-2f03-4cf6-a952-9a6ed1d72798 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:07:36.923760 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-f7a208b7-2f03-4cf6-a952-9a6ed1d72798 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:07:36.924814 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-f7a208b7-2f03-4cf6-a952-9a6ed1d72798 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:07:36.925259 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-f7a208b7-2f03-4cf6-a952-9a6ed1d72798 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:07:37.136297 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-5fc66e8a-6c5b-4550-a907-d3cce1acf4fc tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:07:37.137830 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-5fc66e8a-6c5b-4550-a907-d3cce1acf4fc tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] [instance: b904f233-887c-4c96-a2d2-f7f415ad852f] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:07:37.148862 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-5fc66e8a-6c5b-4550-a907-d3cce1acf4fc tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:07:37.155622 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-5fc66e8a-6c5b-4550-a907-d3cce1acf4fc tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:07:37.157464 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-5fc66e8a-6c5b-4550-a907-d3cce1acf4fc tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:07:37.158186 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-5fc66e8a-6c5b-4550-a907-d3cce1acf4fc tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:07:37.224620 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-f7a208b7-2f03-4cf6-a952-9a6ed1d72798 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abc2e04754884398afc999d423e2a711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2940ca71c4b24b5facc194b61d748a11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:07:37.240453 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-f7a208b7-2f03-4cf6-a952-9a6ed1d72798 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] 10.222.0.20 "GET /compute/v2.1/servers/30391772-c0aa-468b-a414-c40c716a2481" status: 200 len: 1358 microversion: 2.1 time: 0.336418 Jul 01 04:07:37.258545 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 186/365] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:07:36 2022] GET /compute/v2.1/servers/30391772-c0aa-468b-a414-c40c716a2481 => generated 1358 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:07:37.289480 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-586b68fc-c386-4bd4-a006-579c5fb38953 tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:07:37.290296 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-586b68fc-c386-4bd4-a006-579c5fb38953 tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] [instance: 16079191-5fa2-4add-8134-bf7d18446a6a] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:07:37.305398 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-586b68fc-c386-4bd4-a006-579c5fb38953 tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:07:37.309278 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-586b68fc-c386-4bd4-a006-579c5fb38953 tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:07:37.310631 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-586b68fc-c386-4bd4-a006-579c5fb38953 tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:07:37.312978 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-586b68fc-c386-4bd4-a006-579c5fb38953 tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:07:37.644508 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-5fc66e8a-6c5b-4550-a907-d3cce1acf4fc tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:07:37.660484 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-5fc66e8a-6c5b-4550-a907-d3cce1acf4fc tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:07:37.662770 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-5fc66e8a-6c5b-4550-a907-d3cce1acf4fc tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:07:37.664908 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-5fc66e8a-6c5b-4550-a907-d3cce1acf4fc tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] 10.222.0.20 "GET /compute/v2.1/servers/b904f233-887c-4c96-a2d2-f7f415ad852f" status: 200 len: 1808 microversion: 2.20 time: 0.532575 Jul 01 04:07:37.666023 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 180/366] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Jul 1 04:07:37 2022] GET /compute/v2.1/servers/b904f233-887c-4c96-a2d2-f7f415ad852f => generated 1808 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 04:07:38.025016 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [req-4b70838b-da58-4e25-bc4c-6305f6f61a0b req-6a5d71a0-ad42-413b-9351-07917fb7a90b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16079191-5fa2-4add-8134-bf7d18446a6a", "name": "network-vif-plugged", "status": "completed", "tag": "6c8a3556-dbf6-4a9c-a921-5f5d03d9714c"}]} {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 04:07:38.094495 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [req-4b70838b-da58-4e25-bc4c-6305f6f61a0b req-6a5d71a0-ad42-413b-9351-07917fb7a90b service nova] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:07:38.097339 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [req-4b70838b-da58-4e25-bc4c-6305f6f61a0b req-6a5d71a0-ad42-413b-9351-07917fb7a90b service nova] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:07:38.105055 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-586b68fc-c386-4bd4-a006-579c5fb38953 tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021817b0eef94fc2a19d90c511ec9298', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87ca5d9f50847d6ab501ca3a51ab37c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:07:38.128671 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-586b68fc-c386-4bd4-a006-579c5fb38953 tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] 10.222.0.20 "GET /compute/v2.1/servers/16079191-5fa2-4add-8134-bf7d18446a6a" status: 200 len: 1319 microversion: 2.1 time: 0.841482 Jul 01 04:07:38.142178 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.compute.server_external_events [req-4b70838b-da58-4e25-bc4c-6305f6f61a0b req-6a5d71a0-ad42-413b-9351-07917fb7a90b service nova] Creating event network-vif-plugged:6c8a3556-dbf6-4a9c-a921-5f5d03d9714c for instance 16079191-5fa2-4add-8134-bf7d18446a6a on hv-cinder-84684 Jul 01 04:07:38.145526 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 187/367] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:07:37 2022] GET /compute/v2.1/servers/16079191-5fa2-4add-8134-bf7d18446a6a => generated 1319 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 04:07:38.152327 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [req-4b70838b-da58-4e25-bc4c-6305f6f61a0b req-6a5d71a0-ad42-413b-9351-07917fb7a90b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.137423 Jul 01 04:07:38.153768 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 181/368] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Jul 1 04:07:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 01 04:07:38.270462 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-0864176f-a49a-46b9-80c6-30eeefde2c79 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:07:38.272027 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-0864176f-a49a-46b9-80c6-30eeefde2c79 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] [instance: 30391772-c0aa-468b-a414-c40c716a2481] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:07:38.297669 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-0864176f-a49a-46b9-80c6-30eeefde2c79 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:07:38.301503 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-0864176f-a49a-46b9-80c6-30eeefde2c79 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:07:38.304768 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-0864176f-a49a-46b9-80c6-30eeefde2c79 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:07:38.312042 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-0864176f-a49a-46b9-80c6-30eeefde2c79 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:07:38.698080 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-a70bca3e-dd00-4093-b550-c7e8b0a66c05 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:07:38.715514 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-a70bca3e-dd00-4093-b550-c7e8b0a66c05 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] [instance: b904f233-887c-4c96-a2d2-f7f415ad852f] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:07:38.749676 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-a70bca3e-dd00-4093-b550-c7e8b0a66c05 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:07:38.750983 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-a70bca3e-dd00-4093-b550-c7e8b0a66c05 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:07:38.762073 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-a70bca3e-dd00-4093-b550-c7e8b0a66c05 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:07:38.762751 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-a70bca3e-dd00-4093-b550-c7e8b0a66c05 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:07:38.847703 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-0864176f-a49a-46b9-80c6-30eeefde2c79 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abc2e04754884398afc999d423e2a711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2940ca71c4b24b5facc194b61d748a11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:07:38.861981 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-0864176f-a49a-46b9-80c6-30eeefde2c79 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] 10.222.0.20 "GET /compute/v2.1/servers/30391772-c0aa-468b-a414-c40c716a2481" status: 200 len: 1358 microversion: 2.1 time: 0.598790 Jul 01 04:07:38.873964 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 188/369] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:07:38 2022] GET /compute/v2.1/servers/30391772-c0aa-468b-a414-c40c716a2481 => generated 1358 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:07:39.039783 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-a70bca3e-dd00-4093-b550-c7e8b0a66c05 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:07:39.049025 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-a70bca3e-dd00-4093-b550-c7e8b0a66c05 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:07:39.050661 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-a70bca3e-dd00-4093-b550-c7e8b0a66c05 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:07:39.052012 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-a70bca3e-dd00-4093-b550-c7e8b0a66c05 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] 10.222.0.20 "GET /compute/v2.1/servers/b904f233-887c-4c96-a2d2-f7f415ad852f" status: 200 len: 1808 microversion: 2.20 time: 0.364728 Jul 01 04:07:39.063523 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 182/370] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Jul 1 04:07:38 2022] GET /compute/v2.1/servers/b904f233-887c-4c96-a2d2-f7f415ad852f => generated 1808 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 04:07:39.154829 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-cf7d007e-1a5d-430f-80b6-b36e8e60d7bf tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:07:39.156408 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-cf7d007e-1a5d-430f-80b6-b36e8e60d7bf tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] [instance: 16079191-5fa2-4add-8134-bf7d18446a6a] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:07:39.165769 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-cf7d007e-1a5d-430f-80b6-b36e8e60d7bf tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:07:39.166230 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-cf7d007e-1a5d-430f-80b6-b36e8e60d7bf tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:07:39.167273 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-cf7d007e-1a5d-430f-80b6-b36e8e60d7bf tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:07:39.167783 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-cf7d007e-1a5d-430f-80b6-b36e8e60d7bf tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:07:39.441653 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-cf7d007e-1a5d-430f-80b6-b36e8e60d7bf tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021817b0eef94fc2a19d90c511ec9298', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87ca5d9f50847d6ab501ca3a51ab37c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:07:39.455078 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-cf7d007e-1a5d-430f-80b6-b36e8e60d7bf tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] 10.222.0.20 "GET /compute/v2.1/servers/16079191-5fa2-4add-8134-bf7d18446a6a" status: 200 len: 1319 microversion: 2.1 time: 0.305523 Jul 01 04:07:39.457090 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 189/371] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:07:39 2022] GET /compute/v2.1/servers/16079191-5fa2-4add-8134-bf7d18446a6a => generated 1319 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:07:39.880863 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-f3940d9b-73bb-495f-b08c-9f57abffb13e tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:07:39.881660 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-f3940d9b-73bb-495f-b08c-9f57abffb13e tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] [instance: 30391772-c0aa-468b-a414-c40c716a2481] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:07:39.891735 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-f3940d9b-73bb-495f-b08c-9f57abffb13e tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:07:39.893372 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-f3940d9b-73bb-495f-b08c-9f57abffb13e tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:07:39.894374 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-f3940d9b-73bb-495f-b08c-9f57abffb13e tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:07:39.895508 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-f3940d9b-73bb-495f-b08c-9f57abffb13e tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:07:39.934167 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG dbcounter [-] [118711] Writing DB stats nova_cell1:SELECT=100 {{(pid=118711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:07:40.088428 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-a48de61b-6353-4fb5-96cd-53160e5f83a2 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:07:40.088428 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-a48de61b-6353-4fb5-96cd-53160e5f83a2 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] [instance: b904f233-887c-4c96-a2d2-f7f415ad852f] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:07:40.097623 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-a48de61b-6353-4fb5-96cd-53160e5f83a2 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:07:40.098747 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-a48de61b-6353-4fb5-96cd-53160e5f83a2 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:07:40.101874 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-a48de61b-6353-4fb5-96cd-53160e5f83a2 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:07:40.108547 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-a48de61b-6353-4fb5-96cd-53160e5f83a2 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:07:40.111755 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-f3940d9b-73bb-495f-b08c-9f57abffb13e tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abc2e04754884398afc999d423e2a711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2940ca71c4b24b5facc194b61d748a11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:07:40.120999 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-f3940d9b-73bb-495f-b08c-9f57abffb13e tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] 10.222.0.20 "GET /compute/v2.1/servers/30391772-c0aa-468b-a414-c40c716a2481" status: 200 len: 1358 microversion: 2.1 time: 0.244042 Jul 01 04:07:40.121798 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 183/372] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:07:39 2022] GET /compute/v2.1/servers/30391772-c0aa-468b-a414-c40c716a2481 => generated 1358 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 04:07:40.480047 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-2138069f-9454-4651-9736-c8f460b167a0 tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:07:40.480829 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-2138069f-9454-4651-9736-c8f460b167a0 tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] [instance: 16079191-5fa2-4add-8134-bf7d18446a6a] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:07:40.488816 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-2138069f-9454-4651-9736-c8f460b167a0 tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:07:40.489398 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-2138069f-9454-4651-9736-c8f460b167a0 tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:07:40.490282 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-2138069f-9454-4651-9736-c8f460b167a0 tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:07:40.490799 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-2138069f-9454-4651-9736-c8f460b167a0 tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:07:40.748945 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-2138069f-9454-4651-9736-c8f460b167a0 tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021817b0eef94fc2a19d90c511ec9298', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87ca5d9f50847d6ab501ca3a51ab37c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:07:40.763473 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-2138069f-9454-4651-9736-c8f460b167a0 tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] 10.222.0.20 "GET /compute/v2.1/servers/16079191-5fa2-4add-8134-bf7d18446a6a" status: 200 len: 1319 microversion: 2.1 time: 0.287943 Jul 01 04:07:40.768464 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 184/373] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:07:40 2022] GET /compute/v2.1/servers/16079191-5fa2-4add-8134-bf7d18446a6a => generated 1319 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:07:41.146342 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-8d4a9380-4b8f-4857-9d3f-2d74607aed28 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:07:41.148858 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-8d4a9380-4b8f-4857-9d3f-2d74607aed28 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] [instance: 30391772-c0aa-468b-a414-c40c716a2481] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:07:41.165634 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-8d4a9380-4b8f-4857-9d3f-2d74607aed28 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:07:41.166347 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-8d4a9380-4b8f-4857-9d3f-2d74607aed28 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:07:41.167279 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-8d4a9380-4b8f-4857-9d3f-2d74607aed28 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:07:41.167752 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-8d4a9380-4b8f-4857-9d3f-2d74607aed28 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:07:41.181533 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-a48de61b-6353-4fb5-96cd-53160e5f83a2 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:07:41.209454 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-a48de61b-6353-4fb5-96cd-53160e5f83a2 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:07:41.223397 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-a48de61b-6353-4fb5-96cd-53160e5f83a2 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:07:41.230406 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-a48de61b-6353-4fb5-96cd-53160e5f83a2 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] 10.222.0.20 "GET /compute/v2.1/servers/b904f233-887c-4c96-a2d2-f7f415ad852f" status: 200 len: 1808 microversion: 2.20 time: 1.155700 Jul 01 04:07:41.232181 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 190/374] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Jul 1 04:07:40 2022] GET /compute/v2.1/servers/b904f233-887c-4c96-a2d2-f7f415ad852f => generated 1808 bytes in 1165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 04:07:41.403466 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-8d4a9380-4b8f-4857-9d3f-2d74607aed28 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abc2e04754884398afc999d423e2a711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2940ca71c4b24b5facc194b61d748a11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:07:41.414712 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-8d4a9380-4b8f-4857-9d3f-2d74607aed28 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] 10.222.0.20 "GET /compute/v2.1/servers/30391772-c0aa-468b-a414-c40c716a2481" status: 200 len: 1358 microversion: 2.1 time: 0.279254 Jul 01 04:07:41.415962 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 185/375] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:07:41 2022] GET /compute/v2.1/servers/30391772-c0aa-468b-a414-c40c716a2481 => generated 1358 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 04:07:41.480183 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [req-a5256455-a689-4792-a353-3acc37d34791 req-b008f819-94e8-4ca2-85d4-db6fb0fead5f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "30391772-c0aa-468b-a414-c40c716a2481", "name": "network-vif-plugged", "status": "completed", "tag": "0602970e-ed10-4c75-92d7-cd153851994b"}]} {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 04:07:41.516268 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [req-a5256455-a689-4792-a353-3acc37d34791 req-b008f819-94e8-4ca2-85d4-db6fb0fead5f service nova] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:07:41.531755 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [req-a5256455-a689-4792-a353-3acc37d34791 req-b008f819-94e8-4ca2-85d4-db6fb0fead5f service nova] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:07:41.588920 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.compute.server_external_events [req-a5256455-a689-4792-a353-3acc37d34791 req-b008f819-94e8-4ca2-85d4-db6fb0fead5f service nova] Creating event network-vif-plugged:0602970e-ed10-4c75-92d7-cd153851994b for instance 30391772-c0aa-468b-a414-c40c716a2481 on hv-cinder-84684 Jul 01 04:07:41.614328 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [req-a5256455-a689-4792-a353-3acc37d34791 req-b008f819-94e8-4ca2-85d4-db6fb0fead5f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.143385 Jul 01 04:07:41.619060 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 191/376] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Jul 1 04:07:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 04:07:41.802319 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-758f1a84-8129-4ce0-be34-e1361bf13a9f tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:07:41.805915 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-758f1a84-8129-4ce0-be34-e1361bf13a9f tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] [instance: 16079191-5fa2-4add-8134-bf7d18446a6a] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:07:41.831202 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-758f1a84-8129-4ce0-be34-e1361bf13a9f tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:07:41.838983 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-758f1a84-8129-4ce0-be34-e1361bf13a9f tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:07:41.843757 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-758f1a84-8129-4ce0-be34-e1361bf13a9f tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:07:41.848666 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-758f1a84-8129-4ce0-be34-e1361bf13a9f tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:07:42.272247 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-1a9ae7a4-eaaf-4352-9bb1-09622698884a tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:07:42.275723 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-1a9ae7a4-eaaf-4352-9bb1-09622698884a tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] [instance: b904f233-887c-4c96-a2d2-f7f415ad852f] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:07:42.279814 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-758f1a84-8129-4ce0-be34-e1361bf13a9f tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021817b0eef94fc2a19d90c511ec9298', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87ca5d9f50847d6ab501ca3a51ab37c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:07:42.302188 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-1a9ae7a4-eaaf-4352-9bb1-09622698884a tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:07:42.302755 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-1a9ae7a4-eaaf-4352-9bb1-09622698884a tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:07:42.304209 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-1a9ae7a4-eaaf-4352-9bb1-09622698884a tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:07:42.304804 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-1a9ae7a4-eaaf-4352-9bb1-09622698884a tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:07:42.308969 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-758f1a84-8129-4ce0-be34-e1361bf13a9f tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] 10.222.0.20 "GET /compute/v2.1/servers/16079191-5fa2-4add-8134-bf7d18446a6a" status: 200 len: 1507 microversion: 2.1 time: 0.515559 Jul 01 04:07:42.320519 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 186/377] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:07:41 2022] GET /compute/v2.1/servers/16079191-5fa2-4add-8134-bf7d18446a6a => generated 1507 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:07:42.470565 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-b78871a3-fbb1-46b6-8da6-a85d7e646254 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:07:42.482497 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-b78871a3-fbb1-46b6-8da6-a85d7e646254 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] [instance: 30391772-c0aa-468b-a414-c40c716a2481] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:07:42.524698 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-b78871a3-fbb1-46b6-8da6-a85d7e646254 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:07:42.527537 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-b78871a3-fbb1-46b6-8da6-a85d7e646254 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:07:42.530681 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-b78871a3-fbb1-46b6-8da6-a85d7e646254 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:07:42.537961 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-b78871a3-fbb1-46b6-8da6-a85d7e646254 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:07:42.946822 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-b78871a3-fbb1-46b6-8da6-a85d7e646254 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abc2e04754884398afc999d423e2a711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2940ca71c4b24b5facc194b61d748a11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:07:42.966191 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-b78871a3-fbb1-46b6-8da6-a85d7e646254 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] 10.222.0.20 "GET /compute/v2.1/servers/30391772-c0aa-468b-a414-c40c716a2481" status: 200 len: 1358 microversion: 2.1 time: 0.524463 Jul 01 04:07:42.968582 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 187/378] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:07:42 2022] GET /compute/v2.1/servers/30391772-c0aa-468b-a414-c40c716a2481 => generated 1358 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:07:43.038441 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-1a9ae7a4-eaaf-4352-9bb1-09622698884a tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:07:43.056537 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-1a9ae7a4-eaaf-4352-9bb1-09622698884a tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:07:43.064892 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-1a9ae7a4-eaaf-4352-9bb1-09622698884a tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:07:43.070479 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-1a9ae7a4-eaaf-4352-9bb1-09622698884a tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] 10.222.0.20 "GET /compute/v2.1/servers/b904f233-887c-4c96-a2d2-f7f415ad852f" status: 200 len: 1808 microversion: 2.20 time: 0.808523 Jul 01 04:07:43.076017 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 192/379] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Jul 1 04:07:42 2022] GET /compute/v2.1/servers/b904f233-887c-4c96-a2d2-f7f415ad852f => generated 1808 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 04:07:43.997446 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-6de552a0-83e6-4631-b929-8822c02143bb tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:07:43.998376 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-6de552a0-83e6-4631-b929-8822c02143bb tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] [instance: 30391772-c0aa-468b-a414-c40c716a2481] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:07:44.017493 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-6de552a0-83e6-4631-b929-8822c02143bb tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:07:44.018401 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-6de552a0-83e6-4631-b929-8822c02143bb tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:07:44.018905 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-6de552a0-83e6-4631-b929-8822c02143bb tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:07:44.019432 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-6de552a0-83e6-4631-b929-8822c02143bb tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:07:44.108389 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-b5907f55-77af-451e-a69b-0e73240f5a6d tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:07:44.109841 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-b5907f55-77af-451e-a69b-0e73240f5a6d tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] [instance: b904f233-887c-4c96-a2d2-f7f415ad852f] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:07:44.126476 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-b5907f55-77af-451e-a69b-0e73240f5a6d tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:07:44.128009 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-b5907f55-77af-451e-a69b-0e73240f5a6d tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:07:44.129513 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-b5907f55-77af-451e-a69b-0e73240f5a6d tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:07:44.130391 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-b5907f55-77af-451e-a69b-0e73240f5a6d tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:07:44.554192 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-b5907f55-77af-451e-a69b-0e73240f5a6d tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:07:44.606959 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-b5907f55-77af-451e-a69b-0e73240f5a6d tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:07:44.626623 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-b5907f55-77af-451e-a69b-0e73240f5a6d tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:07:44.636933 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-b5907f55-77af-451e-a69b-0e73240f5a6d tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] 10.222.0.20 "GET /compute/v2.1/servers/b904f233-887c-4c96-a2d2-f7f415ad852f" status: 200 len: 1808 microversion: 2.20 time: 0.532242 Jul 01 04:07:44.654417 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 193/380] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Jul 1 04:07:44 2022] GET /compute/v2.1/servers/b904f233-887c-4c96-a2d2-f7f415ad852f => generated 1808 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 04:07:44.750930 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-6de552a0-83e6-4631-b929-8822c02143bb tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abc2e04754884398afc999d423e2a711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2940ca71c4b24b5facc194b61d748a11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:07:44.762103 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-6de552a0-83e6-4631-b929-8822c02143bb tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] 10.222.0.20 "GET /compute/v2.1/servers/30391772-c0aa-468b-a414-c40c716a2481" status: 200 len: 1358 microversion: 2.1 time: 0.771857 Jul 01 04:07:44.774835 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 188/381] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:07:43 2022] GET /compute/v2.1/servers/30391772-c0aa-468b-a414-c40c716a2481 => generated 1358 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:07:45.678041 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-3f8c337e-a2e8-4ac6-a5d4-15048dd0f208 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:07:45.681326 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-3f8c337e-a2e8-4ac6-a5d4-15048dd0f208 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] [instance: b904f233-887c-4c96-a2d2-f7f415ad852f] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:07:45.721336 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-3f8c337e-a2e8-4ac6-a5d4-15048dd0f208 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:07:45.721336 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-3f8c337e-a2e8-4ac6-a5d4-15048dd0f208 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:07:45.724767 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-3f8c337e-a2e8-4ac6-a5d4-15048dd0f208 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:07:45.725774 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-3f8c337e-a2e8-4ac6-a5d4-15048dd0f208 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:07:45.796463 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-3d231a3c-ab50-402b-8686-f52825e48d4a tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:07:45.797697 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-3d231a3c-ab50-402b-8686-f52825e48d4a tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] [instance: 30391772-c0aa-468b-a414-c40c716a2481] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:07:45.814618 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG dbcounter [-] [118711] Writing DB stats nova_api:SELECT=80 {{(pid=118711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:07:45.820436 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-3d231a3c-ab50-402b-8686-f52825e48d4a tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:07:45.823316 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-3d231a3c-ab50-402b-8686-f52825e48d4a tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:07:45.824503 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-3d231a3c-ab50-402b-8686-f52825e48d4a tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:07:45.829750 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-3d231a3c-ab50-402b-8686-f52825e48d4a tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:07:46.350108 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-3d231a3c-ab50-402b-8686-f52825e48d4a tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abc2e04754884398afc999d423e2a711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2940ca71c4b24b5facc194b61d748a11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:07:46.361430 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-3d231a3c-ab50-402b-8686-f52825e48d4a tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] 10.222.0.20 "GET /compute/v2.1/servers/30391772-c0aa-468b-a414-c40c716a2481" status: 200 len: 1358 microversion: 2.1 time: 0.577698 Jul 01 04:07:46.372544 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 189/382] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:07:45 2022] GET /compute/v2.1/servers/30391772-c0aa-468b-a414-c40c716a2481 => generated 1358 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:07:46.391615 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-3f8c337e-a2e8-4ac6-a5d4-15048dd0f208 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:07:46.410343 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-3f8c337e-a2e8-4ac6-a5d4-15048dd0f208 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:07:46.415876 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-3f8c337e-a2e8-4ac6-a5d4-15048dd0f208 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:07:46.431118 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-3f8c337e-a2e8-4ac6-a5d4-15048dd0f208 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] 10.222.0.20 "GET /compute/v2.1/servers/b904f233-887c-4c96-a2d2-f7f415ad852f" status: 200 len: 1808 microversion: 2.20 time: 0.762650 Jul 01 04:07:46.432964 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 194/383] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Jul 1 04:07:45 2022] GET /compute/v2.1/servers/b904f233-887c-4c96-a2d2-f7f415ad852f => generated 1808 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 04:07:47.379626 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-6c198e19-8d68-4c25-bf41-0e1a7ab379fe tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:07:47.381287 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-6c198e19-8d68-4c25-bf41-0e1a7ab379fe tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] [instance: 30391772-c0aa-468b-a414-c40c716a2481] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:07:47.391056 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-6c198e19-8d68-4c25-bf41-0e1a7ab379fe tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:07:47.391938 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-6c198e19-8d68-4c25-bf41-0e1a7ab379fe tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:07:47.393028 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-6c198e19-8d68-4c25-bf41-0e1a7ab379fe tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:07:47.393898 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-6c198e19-8d68-4c25-bf41-0e1a7ab379fe tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:07:47.470666 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-4a04e9d5-771d-4895-a537-89a570674865 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:07:47.472226 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-4a04e9d5-771d-4895-a537-89a570674865 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] [instance: b904f233-887c-4c96-a2d2-f7f415ad852f] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:07:47.503667 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-4a04e9d5-771d-4895-a537-89a570674865 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:07:47.503667 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-4a04e9d5-771d-4895-a537-89a570674865 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:07:47.503667 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-4a04e9d5-771d-4895-a537-89a570674865 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:07:47.503667 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-4a04e9d5-771d-4895-a537-89a570674865 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:07:48.036648 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-6c198e19-8d68-4c25-bf41-0e1a7ab379fe tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abc2e04754884398afc999d423e2a711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2940ca71c4b24b5facc194b61d748a11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:07:48.063457 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-6c198e19-8d68-4c25-bf41-0e1a7ab379fe tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] 10.222.0.20 "GET /compute/v2.1/servers/30391772-c0aa-468b-a414-c40c716a2481" status: 200 len: 1547 microversion: 2.1 time: 0.688352 Jul 01 04:07:48.072457 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 190/384] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:07:47 2022] GET /compute/v2.1/servers/30391772-c0aa-468b-a414-c40c716a2481 => generated 1547 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:07:48.096066 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-b87b1f63-4b02-458c-b7d3-1f35ced1df44 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:07:48.096971 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-b87b1f63-4b02-458c-b7d3-1f35ced1df44 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] [instance: 30391772-c0aa-468b-a414-c40c716a2481] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:07:48.147835 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-b87b1f63-4b02-458c-b7d3-1f35ced1df44 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:07:48.147835 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-b87b1f63-4b02-458c-b7d3-1f35ced1df44 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:07:48.147835 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-b87b1f63-4b02-458c-b7d3-1f35ced1df44 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:07:48.147835 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-b87b1f63-4b02-458c-b7d3-1f35ced1df44 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:07:48.197208 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-4a04e9d5-771d-4895-a537-89a570674865 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:07:48.266662 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-4a04e9d5-771d-4895-a537-89a570674865 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:07:48.273989 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-4a04e9d5-771d-4895-a537-89a570674865 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:07:48.278236 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-4a04e9d5-771d-4895-a537-89a570674865 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] 10.222.0.20 "GET /compute/v2.1/servers/b904f233-887c-4c96-a2d2-f7f415ad852f" status: 200 len: 1808 microversion: 2.20 time: 0.810701 Jul 01 04:07:48.292765 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 195/385] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Jul 1 04:07:47 2022] GET /compute/v2.1/servers/b904f233-887c-4c96-a2d2-f7f415ad852f => generated 1808 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 01 04:07:48.639731 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-b87b1f63-4b02-458c-b7d3-1f35ced1df44 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abc2e04754884398afc999d423e2a711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2940ca71c4b24b5facc194b61d748a11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:07:48.717618 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-b87b1f63-4b02-458c-b7d3-1f35ced1df44 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] 10.222.0.20 "GET /compute/v2.1/servers/30391772-c0aa-468b-a414-c40c716a2481" status: 200 len: 1547 microversion: 2.1 time: 0.627334 Jul 01 04:07:48.735263 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 191/386] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:07:48 2022] GET /compute/v2.1/servers/30391772-c0aa-468b-a414-c40c716a2481 => generated 1547 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:07:48.756307 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-55d4d805-bc74-4c85-9580-c5324f33c278 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:07:48.762808 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-55d4d805-bc74-4c85-9580-c5324f33c278 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'abc2e04754884398afc999d423e2a711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2940ca71c4b24b5facc194b61d748a11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:07:48.762808 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-55d4d805-bc74-4c85-9580-c5324f33c278 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Searching by: {'deleted': False, 'project_id': '2940ca71c4b24b5facc194b61d748a11'} {{(pid=118712) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 01 04:07:48.790653 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-55d4d805-bc74-4c85-9580-c5324f33c278 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:07:48.791369 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-55d4d805-bc74-4c85-9580-c5324f33c278 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:07:48.792563 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-55d4d805-bc74-4c85-9580-c5324f33c278 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:07:48.793187 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-55d4d805-bc74-4c85-9580-c5324f33c278 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:07:48.963403 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.multi_cell_list [None req-55d4d805-bc74-4c85-9580-c5324f33c278 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=118712) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 01 04:07:49.255696 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-55d4d805-bc74-4c85-9580-c5324f33c278 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] 10.222.0.20 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.503785 Jul 01 04:07:49.256788 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 196/387] 10.222.0.20 () {58 vars in 1124 bytes} [Fri Jul 1 04:07:48 2022] GET /compute/v2.1/servers => generated 343 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 01 04:07:49.276195 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-5093c905-7b66-4b70-9086-09868e7d0b1e tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:07:49.277280 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-5093c905-7b66-4b70-9086-09868e7d0b1e tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] [instance: 30391772-c0aa-468b-a414-c40c716a2481] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:07:49.300322 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-5093c905-7b66-4b70-9086-09868e7d0b1e tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:07:49.304630 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-5093c905-7b66-4b70-9086-09868e7d0b1e tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:07:49.307117 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-e9a93cc5-132e-4546-81d0-4cb8d7f04974 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:07:49.308980 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-e9a93cc5-132e-4546-81d0-4cb8d7f04974 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] [instance: b904f233-887c-4c96-a2d2-f7f415ad852f] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:07:49.309223 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-5093c905-7b66-4b70-9086-09868e7d0b1e tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:07:49.310165 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-5093c905-7b66-4b70-9086-09868e7d0b1e tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:07:49.346883 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-e9a93cc5-132e-4546-81d0-4cb8d7f04974 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:07:49.347887 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-e9a93cc5-132e-4546-81d0-4cb8d7f04974 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:07:49.352553 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-e9a93cc5-132e-4546-81d0-4cb8d7f04974 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:07:49.357457 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-e9a93cc5-132e-4546-81d0-4cb8d7f04974 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:07:49.828197 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-5093c905-7b66-4b70-9086-09868e7d0b1e tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abc2e04754884398afc999d423e2a711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2940ca71c4b24b5facc194b61d748a11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:07:49.834776 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-e9a93cc5-132e-4546-81d0-4cb8d7f04974 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:07:49.855084 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-5093c905-7b66-4b70-9086-09868e7d0b1e tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] 10.222.0.20 "GET /compute/v2.1/servers/30391772-c0aa-468b-a414-c40c716a2481" status: 200 len: 1547 microversion: 2.1 time: 0.573684 Jul 01 04:07:49.867841 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 192/388] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:07:49 2022] GET /compute/v2.1/servers/30391772-c0aa-468b-a414-c40c716a2481 => generated 1547 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 04:07:49.870692 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-e9a93cc5-132e-4546-81d0-4cb8d7f04974 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:07:49.876359 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-e9a93cc5-132e-4546-81d0-4cb8d7f04974 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:07:49.877675 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-e9a93cc5-132e-4546-81d0-4cb8d7f04974 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] 10.222.0.20 "GET /compute/v2.1/servers/b904f233-887c-4c96-a2d2-f7f415ad852f" status: 200 len: 1808 microversion: 2.20 time: 0.578801 Jul 01 04:07:49.878139 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 197/389] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Jul 1 04:07:49 2022] GET /compute/v2.1/servers/b904f233-887c-4c96-a2d2-f7f415ad852f => generated 1808 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 01 04:07:50.900526 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-ebd51a91-caca-4dc2-b04b-3b5e0e74cd51 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:07:50.902619 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-ebd51a91-caca-4dc2-b04b-3b5e0e74cd51 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] [instance: b904f233-887c-4c96-a2d2-f7f415ad852f] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:07:50.911842 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-ebd51a91-caca-4dc2-b04b-3b5e0e74cd51 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:07:50.912824 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-ebd51a91-caca-4dc2-b04b-3b5e0e74cd51 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:07:50.914002 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-ebd51a91-caca-4dc2-b04b-3b5e0e74cd51 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:07:50.914712 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-ebd51a91-caca-4dc2-b04b-3b5e0e74cd51 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:07:51.156199 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-ebd51a91-caca-4dc2-b04b-3b5e0e74cd51 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:07:51.175453 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-ebd51a91-caca-4dc2-b04b-3b5e0e74cd51 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:07:51.178478 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-ebd51a91-caca-4dc2-b04b-3b5e0e74cd51 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:07:51.183558 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-ebd51a91-caca-4dc2-b04b-3b5e0e74cd51 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] 10.222.0.20 "GET /compute/v2.1/servers/b904f233-887c-4c96-a2d2-f7f415ad852f" status: 200 len: 1808 microversion: 2.20 time: 0.284469 Jul 01 04:07:51.183558 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 193/390] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Jul 1 04:07:50 2022] GET /compute/v2.1/servers/b904f233-887c-4c96-a2d2-f7f415ad852f => generated 1808 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 04:07:52.201970 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-cab82321-0bd3-4108-b04f-73b8ff7b4f3b tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:07:52.202670 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-cab82321-0bd3-4108-b04f-73b8ff7b4f3b tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] [instance: b904f233-887c-4c96-a2d2-f7f415ad852f] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:07:52.211520 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-cab82321-0bd3-4108-b04f-73b8ff7b4f3b tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:07:52.214463 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-cab82321-0bd3-4108-b04f-73b8ff7b4f3b tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:07:52.220881 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-cab82321-0bd3-4108-b04f-73b8ff7b4f3b tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:07:52.221675 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-cab82321-0bd3-4108-b04f-73b8ff7b4f3b tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:07:52.510403 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-cab82321-0bd3-4108-b04f-73b8ff7b4f3b tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:07:52.532686 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-cab82321-0bd3-4108-b04f-73b8ff7b4f3b tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:07:52.535639 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-cab82321-0bd3-4108-b04f-73b8ff7b4f3b tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:07:52.537244 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-cab82321-0bd3-4108-b04f-73b8ff7b4f3b tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] 10.222.0.20 "GET /compute/v2.1/servers/b904f233-887c-4c96-a2d2-f7f415ad852f" status: 200 len: 1808 microversion: 2.20 time: 0.339540 Jul 01 04:07:52.548131 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 198/391] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Jul 1 04:07:52 2022] GET /compute/v2.1/servers/b904f233-887c-4c96-a2d2-f7f415ad852f => generated 1808 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 04:07:52.972529 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-2a19ee2f-fb85-45c6-a85e-5536e3ad9b75 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a36e352d-600d-42c6-8c86-305bac800221"}} {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 04:07:52.974940 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-2a19ee2f-fb85-45c6-a85e-5536e3ad9b75 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] [instance: 30391772-c0aa-468b-a414-c40c716a2481] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:07:52.993466 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-2a19ee2f-fb85-45c6-a85e-5536e3ad9b75 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:07:53.001648 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-2a19ee2f-fb85-45c6-a85e-5536e3ad9b75 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:07:53.001648 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-2a19ee2f-fb85-45c6-a85e-5536e3ad9b75 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:07:53.001648 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-2a19ee2f-fb85-45c6-a85e-5536e3ad9b75 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:07:53.571943 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-bc8dfabb-4fa8-4705-ab09-9ba4ad332ea9 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:07:53.573951 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-bc8dfabb-4fa8-4705-ab09-9ba4ad332ea9 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] [instance: b904f233-887c-4c96-a2d2-f7f415ad852f] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:07:53.583774 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-bc8dfabb-4fa8-4705-ab09-9ba4ad332ea9 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:07:53.585021 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-bc8dfabb-4fa8-4705-ab09-9ba4ad332ea9 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:07:53.586257 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-bc8dfabb-4fa8-4705-ab09-9ba4ad332ea9 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:07:53.591459 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-bc8dfabb-4fa8-4705-ab09-9ba4ad332ea9 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:07:53.889367 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-bc8dfabb-4fa8-4705-ab09-9ba4ad332ea9 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:07:53.899800 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-bc8dfabb-4fa8-4705-ab09-9ba4ad332ea9 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:07:53.903653 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-bc8dfabb-4fa8-4705-ab09-9ba4ad332ea9 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:07:53.916002 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-bc8dfabb-4fa8-4705-ab09-9ba4ad332ea9 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] 10.222.0.20 "GET /compute/v2.1/servers/b904f233-887c-4c96-a2d2-f7f415ad852f" status: 200 len: 1808 microversion: 2.20 time: 0.338733 Jul 01 04:07:53.917454 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 199/392] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Jul 1 04:07:53 2022] GET /compute/v2.1/servers/b904f233-887c-4c96-a2d2-f7f415ad852f => generated 1808 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 01 04:07:54.141157 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-2a19ee2f-fb85-45c6-a85e-5536e3ad9b75 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] 10.222.0.20 "POST /compute/v2.1/servers/30391772-c0aa-468b-a414-c40c716a2481/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.178137 Jul 01 04:07:54.146619 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 194/393] 10.222.0.20 () {60 vars in 1322 bytes} [Fri Jul 1 04:07:52 2022] POST /compute/v2.1/servers/30391772-c0aa-468b-a414-c40c716a2481/os-volume_attachments => generated 194 bytes in 1180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 04:07:54.924889 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-2f14d491-cc9d-4556-afc5-081bec8f23a2 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:07:54.925533 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-2f14d491-cc9d-4556-afc5-081bec8f23a2 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] [instance: b904f233-887c-4c96-a2d2-f7f415ad852f] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:07:54.927774 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG dbcounter [-] [118712] Writing DB stats nova_api:SELECT=58 {{(pid=118712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:07:54.933592 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-2f14d491-cc9d-4556-afc5-081bec8f23a2 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:07:54.934144 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-2f14d491-cc9d-4556-afc5-081bec8f23a2 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:07:54.936443 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-2f14d491-cc9d-4556-afc5-081bec8f23a2 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:07:54.936443 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-2f14d491-cc9d-4556-afc5-081bec8f23a2 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:07:55.165123 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-2f14d491-cc9d-4556-afc5-081bec8f23a2 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:07:55.195464 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-2f14d491-cc9d-4556-afc5-081bec8f23a2 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:07:55.199828 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-2f14d491-cc9d-4556-afc5-081bec8f23a2 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:07:55.203872 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-2f14d491-cc9d-4556-afc5-081bec8f23a2 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] 10.222.0.20 "GET /compute/v2.1/servers/b904f233-887c-4c96-a2d2-f7f415ad852f" status: 200 len: 1808 microversion: 2.20 time: 0.282914 Jul 01 04:07:55.209955 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 200/394] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Jul 1 04:07:54 2022] GET /compute/v2.1/servers/b904f233-887c-4c96-a2d2-f7f415ad852f => generated 1808 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 04:07:56.228465 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-203c3095-fc37-43de-b9e5-c321a5886c5c tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:07:56.229930 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-203c3095-fc37-43de-b9e5-c321a5886c5c tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] [instance: b904f233-887c-4c96-a2d2-f7f415ad852f] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:07:56.245073 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-203c3095-fc37-43de-b9e5-c321a5886c5c tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:07:56.245567 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-203c3095-fc37-43de-b9e5-c321a5886c5c tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:07:56.246356 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-203c3095-fc37-43de-b9e5-c321a5886c5c tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:07:56.252502 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-203c3095-fc37-43de-b9e5-c321a5886c5c tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:07:56.495257 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-203c3095-fc37-43de-b9e5-c321a5886c5c tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:07:56.504511 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-203c3095-fc37-43de-b9e5-c321a5886c5c tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:07:56.506081 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-203c3095-fc37-43de-b9e5-c321a5886c5c tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:07:56.507295 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-203c3095-fc37-43de-b9e5-c321a5886c5c tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] 10.222.0.20 "GET /compute/v2.1/servers/b904f233-887c-4c96-a2d2-f7f415ad852f" status: 200 len: 1808 microversion: 2.20 time: 0.284085 Jul 01 04:07:56.517975 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 195/395] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Jul 1 04:07:56 2022] GET /compute/v2.1/servers/b904f233-887c-4c96-a2d2-f7f415ad852f => generated 1808 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 04:07:57.527138 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-591dd7a7-cad3-47d6-80df-43b406b7253b tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:07:57.528951 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-591dd7a7-cad3-47d6-80df-43b406b7253b tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] [instance: b904f233-887c-4c96-a2d2-f7f415ad852f] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:07:57.539587 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-591dd7a7-cad3-47d6-80df-43b406b7253b tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:07:57.540058 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-591dd7a7-cad3-47d6-80df-43b406b7253b tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:07:57.540934 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-591dd7a7-cad3-47d6-80df-43b406b7253b tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:07:57.542036 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-591dd7a7-cad3-47d6-80df-43b406b7253b tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:07:57.766317 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-591dd7a7-cad3-47d6-80df-43b406b7253b tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:07:57.770237 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG dbcounter [-] [118712] Writing DB stats nova_cell1:SELECT=100 {{(pid=118712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:07:57.783603 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-591dd7a7-cad3-47d6-80df-43b406b7253b tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:07:57.785526 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-591dd7a7-cad3-47d6-80df-43b406b7253b tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:07:57.787337 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-591dd7a7-cad3-47d6-80df-43b406b7253b tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] 10.222.0.20 "GET /compute/v2.1/servers/b904f233-887c-4c96-a2d2-f7f415ad852f" status: 200 len: 1808 microversion: 2.20 time: 0.265389 Jul 01 04:07:57.788459 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 201/396] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Jul 1 04:07:57 2022] GET /compute/v2.1/servers/b904f233-887c-4c96-a2d2-f7f415ad852f => generated 1808 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 04:07:58.812135 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-101a6756-9683-406b-b09b-d189d6fd030c tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:07:58.813285 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-101a6756-9683-406b-b09b-d189d6fd030c tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] [instance: b904f233-887c-4c96-a2d2-f7f415ad852f] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:07:58.823394 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-101a6756-9683-406b-b09b-d189d6fd030c tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:07:58.823974 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-101a6756-9683-406b-b09b-d189d6fd030c tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:07:58.826141 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-101a6756-9683-406b-b09b-d189d6fd030c tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:07:58.826802 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-101a6756-9683-406b-b09b-d189d6fd030c tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:07:59.184423 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-101a6756-9683-406b-b09b-d189d6fd030c tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:07:59.195721 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-101a6756-9683-406b-b09b-d189d6fd030c tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:07:59.199072 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-101a6756-9683-406b-b09b-d189d6fd030c tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:07:59.200537 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-101a6756-9683-406b-b09b-d189d6fd030c tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] 10.222.0.20 "GET /compute/v2.1/servers/b904f233-887c-4c96-a2d2-f7f415ad852f" status: 200 len: 1808 microversion: 2.20 time: 0.397366 Jul 01 04:07:59.201098 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 196/397] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Jul 1 04:07:58 2022] GET /compute/v2.1/servers/b904f233-887c-4c96-a2d2-f7f415ad852f => generated 1808 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 04:07:59.359392 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG dbcounter [-] [118712] Writing DB stats nova_cell0:SELECT=2 {{(pid=118712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:07:59.777495 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-27fc2774-0b69-4976-8171-154964c92b4f tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Action: 'create', calling method: .version_select at 0x7f99a1182790>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1409661036", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEd965INXfUn6rh3nw/Q/qsgC18jOo7TqoHjZqLeHV1epCsTpOKv+LQpwsfOHIuUxl/xzQMGeQkhL6ZNrdUTMnBrtyvq+GMvupm6kcoTr/1g+kQKs7pE+uBIteH2oPw9WA=="}} {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 04:07:59.800016 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.quota [None req-27fc2774-0b69-4976-8171-154964c92b4f tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Getting quotas for project da99a87350634e9ea8a89f314f5e6118. Resources: {'key_pairs'} {{(pid=118712) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 04:07:59.805175 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.quota [None req-27fc2774-0b69-4976-8171-154964c92b4f tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Getting quotas for user 2e9707561b4a4811bd7a7d3fed4fcd6b and project da99a87350634e9ea8a89f314f5e6118. Resources: {'key_pairs'} {{(pid=118712) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 04:08:00.012942 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-27fc2774-0b69-4976-8171-154964c92b4f tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.665692 Jul 01 04:08:00.016171 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 202/398] 10.222.0.20 () {60 vars in 1158 bytes} [Fri Jul 1 04:07:59 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 04:08:00.222664 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-5b648716-68e8-4df7-9086-7f24b8b478a6 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:08:00.223356 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-5b648716-68e8-4df7-9086-7f24b8b478a6 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] [instance: b904f233-887c-4c96-a2d2-f7f415ad852f] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:08:00.230943 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-5b648716-68e8-4df7-9086-7f24b8b478a6 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:08:00.231391 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-5b648716-68e8-4df7-9086-7f24b8b478a6 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:08:00.232438 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-5b648716-68e8-4df7-9086-7f24b8b478a6 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:08:00.233066 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-5b648716-68e8-4df7-9086-7f24b8b478a6 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:08:00.535986 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-5b648716-68e8-4df7-9086-7f24b8b478a6 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:08:00.555306 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-5b648716-68e8-4df7-9086-7f24b8b478a6 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:08:00.559200 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-5b648716-68e8-4df7-9086-7f24b8b478a6 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:08:00.561412 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-5b648716-68e8-4df7-9086-7f24b8b478a6 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] 10.222.0.20 "GET /compute/v2.1/servers/b904f233-887c-4c96-a2d2-f7f415ad852f" status: 200 len: 1808 microversion: 2.20 time: 0.343871 Jul 01 04:08:00.562370 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 197/399] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Jul 1 04:08:00 2022] GET /compute/v2.1/servers/b904f233-887c-4c96-a2d2-f7f415ad852f => generated 1808 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 04:08:01.174805 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [req-3e25b56d-9e25-4f1b-a9c7-324d17346548 req-9ab0c57f-ae32-49fe-8e2d-6e4e234bc696 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b904f233-887c-4c96-a2d2-f7f415ad852f", "name": "network-vif-plugged", "status": "completed", "tag": "b1d88871-2b18-4397-8234-7831054c30f0"}]} {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 04:08:01.192143 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [req-3e25b56d-9e25-4f1b-a9c7-324d17346548 req-9ab0c57f-ae32-49fe-8e2d-6e4e234bc696 service nova] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:08:01.193055 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [req-3e25b56d-9e25-4f1b-a9c7-324d17346548 req-9ab0c57f-ae32-49fe-8e2d-6e4e234bc696 service nova] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:08:01.213202 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.compute.server_external_events [req-3e25b56d-9e25-4f1b-a9c7-324d17346548 req-9ab0c57f-ae32-49fe-8e2d-6e4e234bc696 service nova] Creating event network-vif-plugged:b1d88871-2b18-4397-8234-7831054c30f0 for instance b904f233-887c-4c96-a2d2-f7f415ad852f on hv-cinder-84684 Jul 01 04:08:01.222859 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [req-3e25b56d-9e25-4f1b-a9c7-324d17346548 req-9ab0c57f-ae32-49fe-8e2d-6e4e234bc696 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062632 Jul 01 04:08:01.223931 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 203/400] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Jul 1 04:08:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 04:08:01.598458 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-0d787396-0b4c-42ec-98b5-e41040ebb1a0 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:08:01.600480 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-0d787396-0b4c-42ec-98b5-e41040ebb1a0 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] [instance: b904f233-887c-4c96-a2d2-f7f415ad852f] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:08:01.616264 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-0d787396-0b4c-42ec-98b5-e41040ebb1a0 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:08:01.617676 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-0d787396-0b4c-42ec-98b5-e41040ebb1a0 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:08:01.619603 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-0d787396-0b4c-42ec-98b5-e41040ebb1a0 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:08:01.620833 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-0d787396-0b4c-42ec-98b5-e41040ebb1a0 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:08:01.820538 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-06fafc31-b9bf-4c33-9985-d61bf24aa981 tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f0a374eb-ffff-468a-9ce1-38b38cfc78d5", "device": "/dev/sdb"}} {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 04:08:01.823459 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-06fafc31-b9bf-4c33-9985-d61bf24aa981 tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] [instance: 16079191-5fa2-4add-8134-bf7d18446a6a] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:08:01.844235 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-06fafc31-b9bf-4c33-9985-d61bf24aa981 tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:08:01.844690 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-06fafc31-b9bf-4c33-9985-d61bf24aa981 tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:08:01.845536 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-06fafc31-b9bf-4c33-9985-d61bf24aa981 tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:08:01.847154 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-06fafc31-b9bf-4c33-9985-d61bf24aa981 tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:08:01.907292 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-0d787396-0b4c-42ec-98b5-e41040ebb1a0 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:08:01.910373 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG dbcounter [-] [118711] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:08:01.925468 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-0d787396-0b4c-42ec-98b5-e41040ebb1a0 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:08:01.929075 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-0d787396-0b4c-42ec-98b5-e41040ebb1a0 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:08:01.934553 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-0d787396-0b4c-42ec-98b5-e41040ebb1a0 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] 10.222.0.20 "GET /compute/v2.1/servers/b904f233-887c-4c96-a2d2-f7f415ad852f" status: 200 len: 1808 microversion: 2.20 time: 0.346962 Jul 01 04:08:01.944554 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 198/401] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Jul 1 04:08:01 2022] GET /compute/v2.1/servers/b904f233-887c-4c96-a2d2-f7f415ad852f => generated 1808 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 04:08:02.959309 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-9f729f2f-3f06-4834-83a4-cb397e52501d tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:08:02.959949 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-9f729f2f-3f06-4834-83a4-cb397e52501d tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] [instance: b904f233-887c-4c96-a2d2-f7f415ad852f] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:08:02.982387 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-9f729f2f-3f06-4834-83a4-cb397e52501d tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:08:02.983374 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-9f729f2f-3f06-4834-83a4-cb397e52501d tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:08:02.987705 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-9f729f2f-3f06-4834-83a4-cb397e52501d tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:08:02.988968 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-9f729f2f-3f06-4834-83a4-cb397e52501d tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:08:02.996531 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-06fafc31-b9bf-4c33-9985-d61bf24aa981 tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] 10.222.0.20 "POST /compute/v2.1/servers/16079191-5fa2-4add-8134-bf7d18446a6a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.180899 Jul 01 04:08:02.999027 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 204/402] 10.222.0.20 () {60 vars in 1322 bytes} [Fri Jul 1 04:08:01 2022] POST /compute/v2.1/servers/16079191-5fa2-4add-8134-bf7d18446a6a/os-volume_attachments => generated 194 bytes in 1185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 04:08:03.236513 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-171a2743-e30c-4bfb-a44b-7ffb9fac3a53 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:08:03.237976 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-171a2743-e30c-4bfb-a44b-7ffb9fac3a53 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] [instance: 30391772-c0aa-468b-a414-c40c716a2481] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:08:03.263631 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-171a2743-e30c-4bfb-a44b-7ffb9fac3a53 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:08:03.267974 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-171a2743-e30c-4bfb-a44b-7ffb9fac3a53 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:08:03.269134 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-171a2743-e30c-4bfb-a44b-7ffb9fac3a53 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:08:03.269765 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-171a2743-e30c-4bfb-a44b-7ffb9fac3a53 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:08:03.275765 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-9f729f2f-3f06-4834-83a4-cb397e52501d tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:08:03.315412 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-9f729f2f-3f06-4834-83a4-cb397e52501d tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:08:03.317867 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-9f729f2f-3f06-4834-83a4-cb397e52501d tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:08:03.334272 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-9f729f2f-3f06-4834-83a4-cb397e52501d tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] 10.222.0.20 "GET /compute/v2.1/servers/b904f233-887c-4c96-a2d2-f7f415ad852f" status: 200 len: 1808 microversion: 2.20 time: 0.380235 Jul 01 04:08:03.336820 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 199/403] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Jul 1 04:08:02 2022] GET /compute/v2.1/servers/b904f233-887c-4c96-a2d2-f7f415ad852f => generated 1808 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 04:08:03.577569 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-171a2743-e30c-4bfb-a44b-7ffb9fac3a53 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abc2e04754884398afc999d423e2a711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2940ca71c4b24b5facc194b61d748a11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:08:03.589821 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-171a2743-e30c-4bfb-a44b-7ffb9fac3a53 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] 10.222.0.20 "GET /compute/v2.1/servers/30391772-c0aa-468b-a414-c40c716a2481" status: 200 len: 1593 microversion: 2.1 time: 0.361258 Jul 01 04:08:03.591646 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 205/404] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:08:03 2022] GET /compute/v2.1/servers/30391772-c0aa-468b-a414-c40c716a2481 => generated 1593 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:08:04.372671 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-cbe484d6-19e3-4af7-bf57-0e1b4f89e0b2 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:08:04.375332 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-cbe484d6-19e3-4af7-bf57-0e1b4f89e0b2 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] [instance: b904f233-887c-4c96-a2d2-f7f415ad852f] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:08:04.414068 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-cbe484d6-19e3-4af7-bf57-0e1b4f89e0b2 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:08:04.415403 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-cbe484d6-19e3-4af7-bf57-0e1b4f89e0b2 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:08:04.417708 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-cbe484d6-19e3-4af7-bf57-0e1b4f89e0b2 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:08:04.418730 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-cbe484d6-19e3-4af7-bf57-0e1b4f89e0b2 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:08:04.737657 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-df586d4d-f173-4306-b0c7-dc9ac796118c tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1aa822c2-aab0-4145-97a3-0137fc264d4e"}} {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 04:08:04.739098 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-df586d4d-f173-4306-b0c7-dc9ac796118c tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] [instance: 1f96263a-e229-447e-aa6b-dd9c2872c751] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:08:04.743483 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-cbe484d6-19e3-4af7-bf57-0e1b4f89e0b2 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:08:04.762158 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-df586d4d-f173-4306-b0c7-dc9ac796118c tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:08:04.762360 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-cbe484d6-19e3-4af7-bf57-0e1b4f89e0b2 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:08:04.762475 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-df586d4d-f173-4306-b0c7-dc9ac796118c tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:08:04.762698 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-df586d4d-f173-4306-b0c7-dc9ac796118c tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:08:04.766102 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-cbe484d6-19e3-4af7-bf57-0e1b4f89e0b2 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:08:04.766900 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-df586d4d-f173-4306-b0c7-dc9ac796118c tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:08:04.769702 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-cbe484d6-19e3-4af7-bf57-0e1b4f89e0b2 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] 10.222.0.20 "GET /compute/v2.1/servers/b904f233-887c-4c96-a2d2-f7f415ad852f" status: 200 len: 1808 microversion: 2.20 time: 0.417672 Jul 01 04:08:04.775036 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 200/405] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Jul 1 04:08:04 2022] GET /compute/v2.1/servers/b904f233-887c-4c96-a2d2-f7f415ad852f => generated 1808 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 01 04:08:05.797089 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-0e5c0d47-03bd-49db-9e34-80bacf5d84fc tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:08:05.798485 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-0e5c0d47-03bd-49db-9e34-80bacf5d84fc tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] [instance: b904f233-887c-4c96-a2d2-f7f415ad852f] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:08:05.806449 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-0e5c0d47-03bd-49db-9e34-80bacf5d84fc tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:08:05.807563 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-0e5c0d47-03bd-49db-9e34-80bacf5d84fc tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:08:05.808341 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-0e5c0d47-03bd-49db-9e34-80bacf5d84fc tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:08:05.808779 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-0e5c0d47-03bd-49db-9e34-80bacf5d84fc tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:08:06.189272 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-df586d4d-f173-4306-b0c7-dc9ac796118c tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] 10.222.0.20 "POST /compute/v2.1/servers/1f96263a-e229-447e-aa6b-dd9c2872c751/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.459979 Jul 01 04:08:06.190290 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 206/406] 10.222.0.20 () {60 vars in 1322 bytes} [Fri Jul 1 04:08:04 2022] POST /compute/v2.1/servers/1f96263a-e229-447e-aa6b-dd9c2872c751/os-volume_attachments => generated 194 bytes in 1462 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 04:08:06.375167 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-0e5c0d47-03bd-49db-9e34-80bacf5d84fc tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:08:06.385275 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-0e5c0d47-03bd-49db-9e34-80bacf5d84fc tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:08:06.386935 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-0e5c0d47-03bd-49db-9e34-80bacf5d84fc tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:08:06.388316 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-0e5c0d47-03bd-49db-9e34-80bacf5d84fc tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] 10.222.0.20 "GET /compute/v2.1/servers/b904f233-887c-4c96-a2d2-f7f415ad852f" status: 200 len: 1808 microversion: 2.20 time: 0.597996 Jul 01 04:08:06.388893 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 201/407] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Jul 1 04:08:05 2022] GET /compute/v2.1/servers/b904f233-887c-4c96-a2d2-f7f415ad852f => generated 1808 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 04:08:07.241988 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [req-0194906d-fcc1-442d-a56f-29d14264c035 req-ff3122e9-32c6-411b-a818-a82545fa9de1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "30391772-c0aa-468b-a414-c40c716a2481", "tag": "0602970e-ed10-4c75-92d7-cd153851994b"}]} {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 04:08:07.252276 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [req-0194906d-fcc1-442d-a56f-29d14264c035 req-ff3122e9-32c6-411b-a818-a82545fa9de1 service nova] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:08:07.253012 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [req-0194906d-fcc1-442d-a56f-29d14264c035 req-ff3122e9-32c6-411b-a818-a82545fa9de1 service nova] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:08:07.264376 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.compute.server_external_events [req-0194906d-fcc1-442d-a56f-29d14264c035 req-ff3122e9-32c6-411b-a818-a82545fa9de1 service nova] Creating event network-changed:0602970e-ed10-4c75-92d7-cd153851994b for instance 30391772-c0aa-468b-a414-c40c716a2481 on hv-cinder-84684 Jul 01 04:08:07.269791 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [req-0194906d-fcc1-442d-a56f-29d14264c035 req-ff3122e9-32c6-411b-a818-a82545fa9de1 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035484 Jul 01 04:08:07.270668 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 207/408] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Jul 1 04:08:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 04:08:07.412587 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-6fbaf695-a0c6-4b80-aa3a-59f35e3e79b6 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:08:07.413665 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-6fbaf695-a0c6-4b80-aa3a-59f35e3e79b6 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] [instance: b904f233-887c-4c96-a2d2-f7f415ad852f] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:08:07.427615 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-6fbaf695-a0c6-4b80-aa3a-59f35e3e79b6 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:08:07.428314 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-6fbaf695-a0c6-4b80-aa3a-59f35e3e79b6 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:08:07.429218 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-6fbaf695-a0c6-4b80-aa3a-59f35e3e79b6 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:08:07.429735 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-6fbaf695-a0c6-4b80-aa3a-59f35e3e79b6 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:08:07.586449 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-6fbaf695-a0c6-4b80-aa3a-59f35e3e79b6 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:08:07.597957 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-6fbaf695-a0c6-4b80-aa3a-59f35e3e79b6 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:08:07.599829 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-6fbaf695-a0c6-4b80-aa3a-59f35e3e79b6 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:08:07.601093 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-6fbaf695-a0c6-4b80-aa3a-59f35e3e79b6 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] 10.222.0.20 "GET /compute/v2.1/servers/b904f233-887c-4c96-a2d2-f7f415ad852f" status: 200 len: 1795 microversion: 2.20 time: 0.197789 Jul 01 04:08:07.601777 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 202/409] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Jul 1 04:08:07 2022] GET /compute/v2.1/servers/b904f233-887c-4c96-a2d2-f7f415ad852f => generated 1795 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 04:08:10.209907 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG dbcounter [-] [118712] Writing DB stats nova_cell0:SELECT=4 {{(pid=118712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:08:10.215084 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-b292d983-2ae5-4f5f-8149-547013c2958f tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1614744188"}} {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 04:08:10.215789 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-b292d983-2ae5-4f5f-8149-547013c2958f tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] [instance: 30391772-c0aa-468b-a414-c40c716a2481] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:08:10.222578 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-b292d983-2ae5-4f5f-8149-547013c2958f tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:08:10.223066 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-b292d983-2ae5-4f5f-8149-547013c2958f tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:08:10.223886 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-b292d983-2ae5-4f5f-8149-547013c2958f tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:08:10.224338 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-b292d983-2ae5-4f5f-8149-547013c2958f tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:08:10.398249 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.network.security_group_api [None req-b292d983-2ae5-4f5f-8149-547013c2958f tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Adding security group cc0d806f-a924-4f60-93da-afd13aaa1945 to port 0602970e-ed10-4c75-92d7-cd153851994b Jul 01 04:08:11.048500 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-b292d983-2ae5-4f5f-8149-547013c2958f tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] 10.222.0.20 "POST /compute/v2.1/servers/30391772-c0aa-468b-a414-c40c716a2481/action" status: 202 len: 0 microversion: 2.1 time: 0.840209 Jul 01 04:08:11.053527 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 208/410] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Jul 1 04:08:10 2022] POST /compute/v2.1/servers/30391772-c0aa-468b-a414-c40c716a2481/action => generated 0 bytes in 846 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 04:08:11.060765 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-97b6c0bb-a5b1-42b5-95c0-79aab0364b12 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:08:11.060765 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-97b6c0bb-a5b1-42b5-95c0-79aab0364b12 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] [instance: 30391772-c0aa-468b-a414-c40c716a2481] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:08:11.073726 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-97b6c0bb-a5b1-42b5-95c0-79aab0364b12 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:08:11.073932 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [req-be25410f-2eb0-4ffb-a91e-7f7dc9013223 req-f8501d23-8173-4a55-8e00-3e0e870c3298 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "30391772-c0aa-468b-a414-c40c716a2481", "tag": "0602970e-ed10-4c75-92d7-cd153851994b"}]} {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 04:08:11.074187 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-97b6c0bb-a5b1-42b5-95c0-79aab0364b12 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:08:11.074989 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-97b6c0bb-a5b1-42b5-95c0-79aab0364b12 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:08:11.075481 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-97b6c0bb-a5b1-42b5-95c0-79aab0364b12 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:08:11.127448 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [req-be25410f-2eb0-4ffb-a91e-7f7dc9013223 req-f8501d23-8173-4a55-8e00-3e0e870c3298 service nova] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:08:11.128614 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [req-be25410f-2eb0-4ffb-a91e-7f7dc9013223 req-f8501d23-8173-4a55-8e00-3e0e870c3298 service nova] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:08:11.162179 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.compute.server_external_events [req-be25410f-2eb0-4ffb-a91e-7f7dc9013223 req-f8501d23-8173-4a55-8e00-3e0e870c3298 service nova] Creating event network-changed:0602970e-ed10-4c75-92d7-cd153851994b for instance 30391772-c0aa-468b-a414-c40c716a2481 on hv-cinder-84684 Jul 01 04:08:11.175837 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [req-be25410f-2eb0-4ffb-a91e-7f7dc9013223 req-f8501d23-8173-4a55-8e00-3e0e870c3298 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.109854 Jul 01 04:08:11.182307 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 209/411] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Jul 1 04:08:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 01 04:08:11.399516 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-97b6c0bb-a5b1-42b5-95c0-79aab0364b12 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abc2e04754884398afc999d423e2a711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2940ca71c4b24b5facc194b61d748a11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:08:11.418738 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-97b6c0bb-a5b1-42b5-95c0-79aab0364b12 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] 10.222.0.20 "GET /compute/v2.1/servers/30391772-c0aa-468b-a414-c40c716a2481" status: 200 len: 1640 microversion: 2.1 time: 0.363726 Jul 01 04:08:11.422430 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 203/412] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:08:11 2022] GET /compute/v2.1/servers/30391772-c0aa-468b-a414-c40c716a2481 => generated 1640 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 04:08:30.504406 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG dbcounter [-] [118712] Writing DB stats nova_api:SELECT=28,nova_api:INSERT=1 {{(pid=118712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:08:30.510159 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG dbcounter [-] [118712] Writing DB stats nova_cell1:SELECT=39,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=118712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:08:30.510370 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-34d77d1c-2618-4c87-b11d-5c8402244052 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 04:08:30.511428 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-34d77d1c-2618-4c87-b11d-5c8402244052 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] [instance: 1f96263a-e229-447e-aa6b-dd9c2872c751] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:08:30.518408 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-34d77d1c-2618-4c87-b11d-5c8402244052 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:08:30.518848 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-34d77d1c-2618-4c87-b11d-5c8402244052 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:08:30.519688 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-34d77d1c-2618-4c87-b11d-5c8402244052 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:08:30.520132 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-34d77d1c-2618-4c87-b11d-5c8402244052 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:08:30.549398 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.objects.instance [None req-34d77d1c-2618-4c87-b11d-5c8402244052 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lazy-loading 'flavor' on Instance uuid 1f96263a-e229-447e-aa6b-dd9c2872c751 {{(pid=118712) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 04:08:31.134401 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-34d77d1c-2618-4c87-b11d-5c8402244052 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] 10.222.0.20 "POST /compute/v2.1/servers/1f96263a-e229-447e-aa6b-dd9c2872c751/action" status: 200 len: 32 microversion: 2.1 time: 0.631312 Jul 01 04:08:31.134986 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 210/413] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Jul 1 04:08:30 2022] POST /compute/v2.1/servers/1f96263a-e229-447e-aa6b-dd9c2872c751/action => generated 32 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 01 04:08:31.147772 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-6e479703-3aae-45fd-95cf-cc9cd2e9160b tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:08:31.148868 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-6e479703-3aae-45fd-95cf-cc9cd2e9160b tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] [instance: 1f96263a-e229-447e-aa6b-dd9c2872c751] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:08:31.152955 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG dbcounter [-] [118711] Writing DB stats nova_api:SELECT=29 {{(pid=118711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:08:31.154038 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG dbcounter [-] [118711] Writing DB stats nova_cell1:SELECT=31 {{(pid=118711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:08:31.162758 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-6e479703-3aae-45fd-95cf-cc9cd2e9160b tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:08:31.163569 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-6e479703-3aae-45fd-95cf-cc9cd2e9160b tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:08:31.164475 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-6e479703-3aae-45fd-95cf-cc9cd2e9160b tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:08:31.164960 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-6e479703-3aae-45fd-95cf-cc9cd2e9160b tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:08:31.404503 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-6e479703-3aae-45fd-95cf-cc9cd2e9160b tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8622ec5212c84d87b9b7c8f725012a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0143140d4f649478e36abcee284640c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:08:31.422042 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-6e479703-3aae-45fd-95cf-cc9cd2e9160b tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] 10.222.0.20 "GET /compute/v2.1/servers/1f96263a-e229-447e-aa6b-dd9c2872c751" status: 200 len: 1736 microversion: 2.1 time: 0.280984 Jul 01 04:08:31.422844 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 204/414] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:08:31 2022] GET /compute/v2.1/servers/1f96263a-e229-447e-aa6b-dd9c2872c751 => generated 1736 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:08:32.445843 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-78a71ada-b492-4b5f-ba1b-9184f24bc36d tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:08:32.446993 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-78a71ada-b492-4b5f-ba1b-9184f24bc36d tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] [instance: 1f96263a-e229-447e-aa6b-dd9c2872c751] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:08:32.454369 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-78a71ada-b492-4b5f-ba1b-9184f24bc36d tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:08:32.454893 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-78a71ada-b492-4b5f-ba1b-9184f24bc36d tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:08:32.455773 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-78a71ada-b492-4b5f-ba1b-9184f24bc36d tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:08:32.456275 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-78a71ada-b492-4b5f-ba1b-9184f24bc36d tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:08:32.609383 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-78a71ada-b492-4b5f-ba1b-9184f24bc36d tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8622ec5212c84d87b9b7c8f725012a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0143140d4f649478e36abcee284640c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:08:32.618703 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-78a71ada-b492-4b5f-ba1b-9184f24bc36d tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] 10.222.0.20 "GET /compute/v2.1/servers/1f96263a-e229-447e-aa6b-dd9c2872c751" status: 200 len: 1736 microversion: 2.1 time: 0.180216 Jul 01 04:08:32.619512 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 211/415] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:08:32 2022] GET /compute/v2.1/servers/1f96263a-e229-447e-aa6b-dd9c2872c751 => generated 1736 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:08:33.636980 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-3a253391-d815-4227-b0d8-3b5a23e206ca tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:08:33.637534 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-3a253391-d815-4227-b0d8-3b5a23e206ca tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] [instance: 1f96263a-e229-447e-aa6b-dd9c2872c751] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:08:33.644768 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-3a253391-d815-4227-b0d8-3b5a23e206ca tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:08:33.645242 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-3a253391-d815-4227-b0d8-3b5a23e206ca tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:08:33.646057 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-3a253391-d815-4227-b0d8-3b5a23e206ca tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:08:33.646493 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-3a253391-d815-4227-b0d8-3b5a23e206ca tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:08:33.796962 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-3a253391-d815-4227-b0d8-3b5a23e206ca tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8622ec5212c84d87b9b7c8f725012a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0143140d4f649478e36abcee284640c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:08:33.805476 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-3a253391-d815-4227-b0d8-3b5a23e206ca tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] 10.222.0.20 "GET /compute/v2.1/servers/1f96263a-e229-447e-aa6b-dd9c2872c751" status: 200 len: 1736 microversion: 2.1 time: 0.173029 Jul 01 04:08:33.814746 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 205/416] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:08:33 2022] GET /compute/v2.1/servers/1f96263a-e229-447e-aa6b-dd9c2872c751 => generated 1736 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 04:08:34.824532 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-f19ec4f7-9346-4108-b11b-ff1e489465cb tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:08:34.825149 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-f19ec4f7-9346-4108-b11b-ff1e489465cb tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] [instance: 1f96263a-e229-447e-aa6b-dd9c2872c751] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:08:34.832290 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-f19ec4f7-9346-4108-b11b-ff1e489465cb tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:08:34.832750 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-f19ec4f7-9346-4108-b11b-ff1e489465cb tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:08:34.833537 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-f19ec4f7-9346-4108-b11b-ff1e489465cb tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:08:34.833980 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-f19ec4f7-9346-4108-b11b-ff1e489465cb tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:08:34.982007 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-f19ec4f7-9346-4108-b11b-ff1e489465cb tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8622ec5212c84d87b9b7c8f725012a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0143140d4f649478e36abcee284640c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:08:34.991574 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-f19ec4f7-9346-4108-b11b-ff1e489465cb tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] 10.222.0.20 "GET /compute/v2.1/servers/1f96263a-e229-447e-aa6b-dd9c2872c751" status: 200 len: 1736 microversion: 2.1 time: 0.171434 Jul 01 04:08:34.992198 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 212/417] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:08:34 2022] GET /compute/v2.1/servers/1f96263a-e229-447e-aa6b-dd9c2872c751 => generated 1736 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:08:36.008953 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-f8625f96-e7b3-44c4-93d5-9f1728247340 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:08:36.009752 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-f8625f96-e7b3-44c4-93d5-9f1728247340 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] [instance: 1f96263a-e229-447e-aa6b-dd9c2872c751] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:08:36.017379 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-f8625f96-e7b3-44c4-93d5-9f1728247340 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:08:36.017831 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-f8625f96-e7b3-44c4-93d5-9f1728247340 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:08:36.018617 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-f8625f96-e7b3-44c4-93d5-9f1728247340 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:08:36.020783 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-f8625f96-e7b3-44c4-93d5-9f1728247340 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:08:36.165571 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-f8625f96-e7b3-44c4-93d5-9f1728247340 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8622ec5212c84d87b9b7c8f725012a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0143140d4f649478e36abcee284640c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:08:36.174310 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-f8625f96-e7b3-44c4-93d5-9f1728247340 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] 10.222.0.20 "GET /compute/v2.1/servers/1f96263a-e229-447e-aa6b-dd9c2872c751" status: 200 len: 1736 microversion: 2.1 time: 0.169184 Jul 01 04:08:36.174914 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 206/418] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:08:36 2022] GET /compute/v2.1/servers/1f96263a-e229-447e-aa6b-dd9c2872c751 => generated 1736 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:08:37.196148 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-cf144ae4-b30b-4959-9e19-8abc3576daf4 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:08:37.196921 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-cf144ae4-b30b-4959-9e19-8abc3576daf4 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] [instance: 1f96263a-e229-447e-aa6b-dd9c2872c751] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:08:37.204043 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-cf144ae4-b30b-4959-9e19-8abc3576daf4 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:08:37.204537 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-cf144ae4-b30b-4959-9e19-8abc3576daf4 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:08:37.205423 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-cf144ae4-b30b-4959-9e19-8abc3576daf4 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:08:37.205895 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-cf144ae4-b30b-4959-9e19-8abc3576daf4 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:08:37.349496 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-cf144ae4-b30b-4959-9e19-8abc3576daf4 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8622ec5212c84d87b9b7c8f725012a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0143140d4f649478e36abcee284640c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:08:37.356172 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-cf144ae4-b30b-4959-9e19-8abc3576daf4 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] 10.222.0.20 "GET /compute/v2.1/servers/1f96263a-e229-447e-aa6b-dd9c2872c751" status: 200 len: 1736 microversion: 2.1 time: 0.163974 Jul 01 04:08:37.356834 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 213/419] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:08:37 2022] GET /compute/v2.1/servers/1f96263a-e229-447e-aa6b-dd9c2872c751 => generated 1736 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 04:08:37.820114 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-fd01e6f8-524e-4a83-a4ab-1bd0d6d4f66c tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:08:37.820709 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-fd01e6f8-524e-4a83-a4ab-1bd0d6d4f66c tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] [instance: 16079191-5fa2-4add-8134-bf7d18446a6a] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:08:37.827892 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-fd01e6f8-524e-4a83-a4ab-1bd0d6d4f66c tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:08:37.828339 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-fd01e6f8-524e-4a83-a4ab-1bd0d6d4f66c tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:08:37.829102 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-fd01e6f8-524e-4a83-a4ab-1bd0d6d4f66c tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:08:37.829536 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-fd01e6f8-524e-4a83-a4ab-1bd0d6d4f66c tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:08:37.964092 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.objects.instance [None req-fd01e6f8-524e-4a83-a4ab-1bd0d6d4f66c tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Lazy-loading 'services' on Instance uuid 16079191-5fa2-4add-8134-bf7d18446a6a {{(pid=118711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 04:08:38.376281 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-ee92a7bd-b528-4947-8e6d-475bda92bf60 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:08:38.377154 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-ee92a7bd-b528-4947-8e6d-475bda92bf60 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] [instance: 1f96263a-e229-447e-aa6b-dd9c2872c751] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:08:38.386748 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-ee92a7bd-b528-4947-8e6d-475bda92bf60 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:08:38.387208 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-ee92a7bd-b528-4947-8e6d-475bda92bf60 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:08:38.388034 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-ee92a7bd-b528-4947-8e6d-475bda92bf60 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:08:38.388528 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-ee92a7bd-b528-4947-8e6d-475bda92bf60 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:08:38.403004 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-fd01e6f8-524e-4a83-a4ab-1bd0d6d4f66c tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] 10.222.0.20 "DELETE /compute/v2.1/servers/16079191-5fa2-4add-8134-bf7d18446a6a/os-volume_attachments/f0a374eb-ffff-468a-9ce1-38b38cfc78d5" status: 202 len: 0 microversion: 2.1 time: 0.586100 Jul 01 04:08:38.407532 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 207/420] 10.222.0.20 () {58 vars in 1415 bytes} [Fri Jul 1 04:08:37 2022] DELETE /compute/v2.1/servers/16079191-5fa2-4add-8134-bf7d18446a6a/os-volume_attachments/f0a374eb-ffff-468a-9ce1-38b38cfc78d5 => generated 0 bytes in 589 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 04:08:38.444345 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-66f80f9d-cbba-454d-89fd-47267b640d9c tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-2044010793", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1409661036", "security_groups": [{"name": "tempest-secgroup-smoke-708261767"}], "block_device_mapping_v2": [{"uuid": "093185d7-a641-4c7a-88d8-9bd9414b4981", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "cc357e98-d192-47c0-8330-c661a213b80c"}]}} {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 04:08:38.585050 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-ee92a7bd-b528-4947-8e6d-475bda92bf60 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8622ec5212c84d87b9b7c8f725012a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0143140d4f649478e36abcee284640c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:08:38.595561 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-ee92a7bd-b528-4947-8e6d-475bda92bf60 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] 10.222.0.20 "GET /compute/v2.1/servers/1f96263a-e229-447e-aa6b-dd9c2872c751" status: 200 len: 1736 microversion: 2.1 time: 0.224646 Jul 01 04:08:38.596164 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 214/421] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:08:38 2022] GET /compute/v2.1/servers/1f96263a-e229-447e-aa6b-dd9c2872c751 => generated 1736 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:08:38.607616 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.network.neutron [None req-66f80f9d-cbba-454d-89fd-47267b640d9c tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] validate_networks() for [('cc357e98-d192-47c0-8330-c661a213b80c', None, None, None, None, None)] {{(pid=118711) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 01 04:08:39.017696 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.virt.hardware [None req-66f80f9d-cbba-454d-89fd-47267b640d9c tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Flavor limits 0:0:0 {{(pid=118711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 01 04:08:39.018274 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.virt.hardware [None req-66f80f9d-cbba-454d-89fd-47267b640d9c tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Image limits 0:0:0 {{(pid=118711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 01 04:08:39.018557 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.virt.hardware [None req-66f80f9d-cbba-454d-89fd-47267b640d9c tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Flavor pref 0:0:0 {{(pid=118711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 01 04:08:39.019012 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.virt.hardware [None req-66f80f9d-cbba-454d-89fd-47267b640d9c tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Image pref 0:0:0 {{(pid=118711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 01 04:08:39.019445 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.virt.hardware [None req-66f80f9d-cbba-454d-89fd-47267b640d9c tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 01 04:08:39.029863 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-66f80f9d-cbba-454d-89fd-47267b640d9c tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:08:39.030320 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-66f80f9d-cbba-454d-89fd-47267b640d9c tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:08:39.031145 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-66f80f9d-cbba-454d-89fd-47267b640d9c tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:08:39.031616 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-66f80f9d-cbba-454d-89fd-47267b640d9c tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:08:39.051000 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.quota [None req-66f80f9d-cbba-454d-89fd-47267b640d9c tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Getting quotas for project da99a87350634e9ea8a89f314f5e6118. Resources: {'ram', 'cores', 'instances'} {{(pid=118711) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 04:08:39.055496 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.quota [None req-66f80f9d-cbba-454d-89fd-47267b640d9c tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Getting quotas for user 2e9707561b4a4811bd7a7d3fed4fcd6b and project da99a87350634e9ea8a89f314f5e6118. Resources: {'ram', 'cores', 'instances'} {{(pid=118711) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 04:08:39.117395 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-66f80f9d-cbba-454d-89fd-47267b640d9c tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Going to run 1 instances... {{(pid=118711) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 01 04:08:39.119606 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-66f80f9d-cbba-454d-89fd-47267b640d9c tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] [instance: 246ef166-ec68-4657-b7b2-529c41cb4429] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='093185d7-a641-4c7a-88d8-9bd9414b4981',volume_size=None,volume_type=None)] {{(pid=118711) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 01 04:08:39.561774 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-66f80f9d-cbba-454d-89fd-47267b640d9c tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.121651 Jul 01 04:08:39.562401 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 208/422] 10.222.0.20 () {60 vars in 1146 bytes} [Fri Jul 1 04:08:38 2022] POST /compute/v2.1/servers => generated 405 bytes in 1123 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 01 04:08:39.575003 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-cdb0dbac-0925-43e0-85e0-105722d96ea7 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:08:39.575927 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-cdb0dbac-0925-43e0-85e0-105722d96ea7 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] [instance: 246ef166-ec68-4657-b7b2-529c41cb4429] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:08:39.614231 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-eb12d15c-ffd1-4d17-8def-3a46831f17cd tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:08:39.615150 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-eb12d15c-ffd1-4d17-8def-3a46831f17cd tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] [instance: 1f96263a-e229-447e-aa6b-dd9c2872c751] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:08:39.623047 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-eb12d15c-ffd1-4d17-8def-3a46831f17cd tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:08:39.623543 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-eb12d15c-ffd1-4d17-8def-3a46831f17cd tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:08:39.624375 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-eb12d15c-ffd1-4d17-8def-3a46831f17cd tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:08:39.624859 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-eb12d15c-ffd1-4d17-8def-3a46831f17cd tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:08:39.647771 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-cdb0dbac-0925-43e0-85e0-105722d96ea7 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e9707561b4a4811bd7a7d3fed4fcd6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da99a87350634e9ea8a89f314f5e6118', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:08:39.657237 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-cdb0dbac-0925-43e0-85e0-105722d96ea7 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] 10.222.0.20 "GET /compute/v2.1/servers/246ef166-ec68-4657-b7b2-529c41cb4429" status: 200 len: 1095 microversion: 2.1 time: 0.087050 Jul 01 04:08:39.667314 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 215/423] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:08:39 2022] GET /compute/v2.1/servers/246ef166-ec68-4657-b7b2-529c41cb4429 => generated 1095 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 04:08:39.809840 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-eb12d15c-ffd1-4d17-8def-3a46831f17cd tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8622ec5212c84d87b9b7c8f725012a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0143140d4f649478e36abcee284640c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:08:39.818849 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-eb12d15c-ffd1-4d17-8def-3a46831f17cd tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] 10.222.0.20 "GET /compute/v2.1/servers/1f96263a-e229-447e-aa6b-dd9c2872c751" status: 200 len: 1736 microversion: 2.1 time: 0.208520 Jul 01 04:08:39.819519 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 209/424] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:08:39 2022] GET /compute/v2.1/servers/1f96263a-e229-447e-aa6b-dd9c2872c751 => generated 1736 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 04:08:40.674664 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-6511cf90-fd5e-4f32-b2b2-e5edb02e7dce tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:08:40.675364 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-6511cf90-fd5e-4f32-b2b2-e5edb02e7dce tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] [instance: 246ef166-ec68-4657-b7b2-529c41cb4429] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:08:40.739483 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-6511cf90-fd5e-4f32-b2b2-e5edb02e7dce tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e9707561b4a4811bd7a7d3fed4fcd6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da99a87350634e9ea8a89f314f5e6118', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:08:40.746769 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-6511cf90-fd5e-4f32-b2b2-e5edb02e7dce tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] 10.222.0.20 "GET /compute/v2.1/servers/246ef166-ec68-4657-b7b2-529c41cb4429" status: 200 len: 1095 microversion: 2.1 time: 0.076061 Jul 01 04:08:40.747350 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 216/425] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:08:40 2022] GET /compute/v2.1/servers/246ef166-ec68-4657-b7b2-529c41cb4429 => generated 1095 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:08:40.837304 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-ef1b6d49-4b64-4c30-98da-8f6e0a10b1d2 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:08:40.837893 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-ef1b6d49-4b64-4c30-98da-8f6e0a10b1d2 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] [instance: 1f96263a-e229-447e-aa6b-dd9c2872c751] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:08:40.844691 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-ef1b6d49-4b64-4c30-98da-8f6e0a10b1d2 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:08:40.845160 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-ef1b6d49-4b64-4c30-98da-8f6e0a10b1d2 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:08:40.845920 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-ef1b6d49-4b64-4c30-98da-8f6e0a10b1d2 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:08:40.846354 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-ef1b6d49-4b64-4c30-98da-8f6e0a10b1d2 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:08:40.979431 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-ef1b6d49-4b64-4c30-98da-8f6e0a10b1d2 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8622ec5212c84d87b9b7c8f725012a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0143140d4f649478e36abcee284640c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:08:40.987767 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-ef1b6d49-4b64-4c30-98da-8f6e0a10b1d2 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] 10.222.0.20 "GET /compute/v2.1/servers/1f96263a-e229-447e-aa6b-dd9c2872c751" status: 200 len: 1736 microversion: 2.1 time: 0.154344 Jul 01 04:08:40.988377 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 210/426] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:08:40 2022] GET /compute/v2.1/servers/1f96263a-e229-447e-aa6b-dd9c2872c751 => generated 1736 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:08:41.763556 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-ca4103b4-5cf9-48b5-a227-6fa6ec98b1fb tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:08:41.764172 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-ca4103b4-5cf9-48b5-a227-6fa6ec98b1fb tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] [instance: 246ef166-ec68-4657-b7b2-529c41cb4429] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:08:41.770799 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-ca4103b4-5cf9-48b5-a227-6fa6ec98b1fb tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:08:41.771286 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-ca4103b4-5cf9-48b5-a227-6fa6ec98b1fb tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:08:41.772113 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-ca4103b4-5cf9-48b5-a227-6fa6ec98b1fb tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:08:41.772530 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-ca4103b4-5cf9-48b5-a227-6fa6ec98b1fb tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:08:41.840029 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-ca4103b4-5cf9-48b5-a227-6fa6ec98b1fb tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e9707561b4a4811bd7a7d3fed4fcd6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da99a87350634e9ea8a89f314f5e6118', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:08:41.847903 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-ca4103b4-5cf9-48b5-a227-6fa6ec98b1fb tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] 10.222.0.20 "GET /compute/v2.1/servers/246ef166-ec68-4657-b7b2-529c41cb4429" status: 200 len: 1145 microversion: 2.1 time: 0.088514 Jul 01 04:08:41.848494 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 217/427] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:08:41 2022] GET /compute/v2.1/servers/246ef166-ec68-4657-b7b2-529c41cb4429 => generated 1145 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:08:42.005637 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-d29d34db-bf75-45f3-bcfb-544ada5fc57f tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:08:42.007108 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-d29d34db-bf75-45f3-bcfb-544ada5fc57f tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] [instance: 1f96263a-e229-447e-aa6b-dd9c2872c751] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:08:42.013976 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-d29d34db-bf75-45f3-bcfb-544ada5fc57f tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:08:42.014431 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-d29d34db-bf75-45f3-bcfb-544ada5fc57f tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:08:42.015255 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-d29d34db-bf75-45f3-bcfb-544ada5fc57f tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:08:42.015695 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-d29d34db-bf75-45f3-bcfb-544ada5fc57f tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:08:42.161045 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-d29d34db-bf75-45f3-bcfb-544ada5fc57f tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8622ec5212c84d87b9b7c8f725012a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0143140d4f649478e36abcee284640c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:08:42.169935 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-d29d34db-bf75-45f3-bcfb-544ada5fc57f tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] 10.222.0.20 "GET /compute/v2.1/servers/1f96263a-e229-447e-aa6b-dd9c2872c751" status: 200 len: 1736 microversion: 2.1 time: 0.168023 Jul 01 04:08:42.170534 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 211/428] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:08:42 2022] GET /compute/v2.1/servers/1f96263a-e229-447e-aa6b-dd9c2872c751 => generated 1736 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:08:42.868360 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-6aa687d1-1358-415a-87e5-85217a5e674a tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:08:42.868981 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-6aa687d1-1358-415a-87e5-85217a5e674a tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] [instance: 246ef166-ec68-4657-b7b2-529c41cb4429] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:08:42.875580 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-6aa687d1-1358-415a-87e5-85217a5e674a tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:08:42.876072 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-6aa687d1-1358-415a-87e5-85217a5e674a tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:08:42.876872 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-6aa687d1-1358-415a-87e5-85217a5e674a tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:08:42.877316 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-6aa687d1-1358-415a-87e5-85217a5e674a tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:08:42.939698 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-6aa687d1-1358-415a-87e5-85217a5e674a tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e9707561b4a4811bd7a7d3fed4fcd6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da99a87350634e9ea8a89f314f5e6118', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:08:42.947579 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-6aa687d1-1358-415a-87e5-85217a5e674a tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] 10.222.0.20 "GET /compute/v2.1/servers/246ef166-ec68-4657-b7b2-529c41cb4429" status: 200 len: 1193 microversion: 2.1 time: 0.083082 Jul 01 04:08:42.948164 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 218/429] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:08:42 2022] GET /compute/v2.1/servers/246ef166-ec68-4657-b7b2-529c41cb4429 => generated 1193 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:08:43.190310 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-a0d6eb2b-bf14-455d-ab88-5cf69c1209f2 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:08:43.190873 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-a0d6eb2b-bf14-455d-ab88-5cf69c1209f2 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] [instance: 1f96263a-e229-447e-aa6b-dd9c2872c751] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:08:43.199045 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-a0d6eb2b-bf14-455d-ab88-5cf69c1209f2 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:08:43.199530 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-a0d6eb2b-bf14-455d-ab88-5cf69c1209f2 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:08:43.200972 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-a0d6eb2b-bf14-455d-ab88-5cf69c1209f2 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:08:43.201432 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-a0d6eb2b-bf14-455d-ab88-5cf69c1209f2 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:08:43.370430 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-a0d6eb2b-bf14-455d-ab88-5cf69c1209f2 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8622ec5212c84d87b9b7c8f725012a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0143140d4f649478e36abcee284640c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:08:43.381078 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-a0d6eb2b-bf14-455d-ab88-5cf69c1209f2 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] 10.222.0.20 "GET /compute/v2.1/servers/1f96263a-e229-447e-aa6b-dd9c2872c751" status: 200 len: 1736 microversion: 2.1 time: 0.196518 Jul 01 04:08:43.382282 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 212/430] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:08:43 2022] GET /compute/v2.1/servers/1f96263a-e229-447e-aa6b-dd9c2872c751 => generated 1736 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:08:43.820906 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-d02ed2d7-8d6c-42a8-ad5a-d9327503a3f5 tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:08:43.821465 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-d02ed2d7-8d6c-42a8-ad5a-d9327503a3f5 tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] [instance: 16079191-5fa2-4add-8134-bf7d18446a6a] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:08:43.827951 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-d02ed2d7-8d6c-42a8-ad5a-d9327503a3f5 tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:08:43.832882 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-d02ed2d7-8d6c-42a8-ad5a-d9327503a3f5 tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:08:43.832882 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-d02ed2d7-8d6c-42a8-ad5a-d9327503a3f5 tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:08:43.832882 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-d02ed2d7-8d6c-42a8-ad5a-d9327503a3f5 tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:08:43.855717 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-d02ed2d7-8d6c-42a8-ad5a-d9327503a3f5 tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] [instance: 16079191-5fa2-4add-8134-bf7d18446a6a] Going to try to terminate instance {{(pid=118712) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 01 04:08:43.964799 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-91c4ae3a-bcfe-469a-ace5-7a4da93f905c tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:08:43.965624 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-91c4ae3a-bcfe-469a-ace5-7a4da93f905c tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] [instance: 246ef166-ec68-4657-b7b2-529c41cb4429] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:08:43.972018 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-91c4ae3a-bcfe-469a-ace5-7a4da93f905c tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:08:43.972581 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-91c4ae3a-bcfe-469a-ace5-7a4da93f905c tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:08:43.973423 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-91c4ae3a-bcfe-469a-ace5-7a4da93f905c tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:08:43.973939 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-91c4ae3a-bcfe-469a-ace5-7a4da93f905c tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:08:44.160418 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-d02ed2d7-8d6c-42a8-ad5a-d9327503a3f5 tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] 10.222.0.20 "DELETE /compute/v2.1/servers/16079191-5fa2-4add-8134-bf7d18446a6a" status: 204 len: 0 microversion: 2.1 time: 0.343191 Jul 01 04:08:44.161118 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 219/431] 10.222.0.20 () {58 vars in 1238 bytes} [Fri Jul 1 04:08:43 2022] DELETE /compute/v2.1/servers/16079191-5fa2-4add-8134-bf7d18446a6a => generated 0 bytes in 345 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 01 04:08:44.171414 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-5b4dfcfb-0eaf-4d8d-9c9c-c6bfce0d8937 tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:08:44.172131 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-5b4dfcfb-0eaf-4d8d-9c9c-c6bfce0d8937 tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] [instance: 16079191-5fa2-4add-8134-bf7d18446a6a] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:08:44.178477 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-5b4dfcfb-0eaf-4d8d-9c9c-c6bfce0d8937 tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:08:44.178932 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-5b4dfcfb-0eaf-4d8d-9c9c-c6bfce0d8937 tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:08:44.179755 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-5b4dfcfb-0eaf-4d8d-9c9c-c6bfce0d8937 tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:08:44.180209 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-5b4dfcfb-0eaf-4d8d-9c9c-c6bfce0d8937 tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:08:44.273155 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-91c4ae3a-bcfe-469a-ace5-7a4da93f905c tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e9707561b4a4811bd7a7d3fed4fcd6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da99a87350634e9ea8a89f314f5e6118', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:08:44.282338 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-91c4ae3a-bcfe-469a-ace5-7a4da93f905c tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] 10.222.0.20 "GET /compute/v2.1/servers/246ef166-ec68-4657-b7b2-529c41cb4429" status: 200 len: 1211 microversion: 2.1 time: 0.321146 Jul 01 04:08:44.297725 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 213/432] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:08:43 2022] GET /compute/v2.1/servers/246ef166-ec68-4657-b7b2-529c41cb4429 => generated 1211 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:08:44.328925 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-5b4dfcfb-0eaf-4d8d-9c9c-c6bfce0d8937 tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021817b0eef94fc2a19d90c511ec9298', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87ca5d9f50847d6ab501ca3a51ab37c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:08:44.336820 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-5b4dfcfb-0eaf-4d8d-9c9c-c6bfce0d8937 tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] 10.222.0.20 "GET /compute/v2.1/servers/16079191-5fa2-4add-8134-bf7d18446a6a" status: 200 len: 1513 microversion: 2.1 time: 0.170565 Jul 01 04:08:44.337423 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 220/433] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:08:44 2022] GET /compute/v2.1/servers/16079191-5fa2-4add-8134-bf7d18446a6a => generated 1513 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 04:08:44.398882 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-0b9e6aa8-2d86-4056-8933-a0ff3624bf96 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:08:44.399559 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-0b9e6aa8-2d86-4056-8933-a0ff3624bf96 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] [instance: 1f96263a-e229-447e-aa6b-dd9c2872c751] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:08:44.406964 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-0b9e6aa8-2d86-4056-8933-a0ff3624bf96 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:08:44.407455 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-0b9e6aa8-2d86-4056-8933-a0ff3624bf96 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:08:44.408228 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-0b9e6aa8-2d86-4056-8933-a0ff3624bf96 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:08:44.408690 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-0b9e6aa8-2d86-4056-8933-a0ff3624bf96 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:08:44.613639 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-0b9e6aa8-2d86-4056-8933-a0ff3624bf96 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8622ec5212c84d87b9b7c8f725012a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0143140d4f649478e36abcee284640c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:08:44.630504 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-0b9e6aa8-2d86-4056-8933-a0ff3624bf96 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] 10.222.0.20 "GET /compute/v2.1/servers/1f96263a-e229-447e-aa6b-dd9c2872c751" status: 200 len: 1736 microversion: 2.1 time: 0.235350 Jul 01 04:08:44.635858 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 214/434] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:08:44 2022] GET /compute/v2.1/servers/1f96263a-e229-447e-aa6b-dd9c2872c751 => generated 1736 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:08:45.304688 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-96ba5a57-c631-4f10-a782-faea4528be3e tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:08:45.306549 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-96ba5a57-c631-4f10-a782-faea4528be3e tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] [instance: 246ef166-ec68-4657-b7b2-529c41cb4429] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:08:45.312501 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-96ba5a57-c631-4f10-a782-faea4528be3e tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:08:45.312957 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-96ba5a57-c631-4f10-a782-faea4528be3e tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:08:45.313762 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-96ba5a57-c631-4f10-a782-faea4528be3e tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:08:45.314205 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-96ba5a57-c631-4f10-a782-faea4528be3e tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:08:45.355414 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-13790b64-a64e-4c39-9014-2e9483726629 tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:08:45.356663 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-13790b64-a64e-4c39-9014-2e9483726629 tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] [instance: 16079191-5fa2-4add-8134-bf7d18446a6a] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:08:45.363342 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-13790b64-a64e-4c39-9014-2e9483726629 tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:08:45.363799 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-13790b64-a64e-4c39-9014-2e9483726629 tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:08:45.364577 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-13790b64-a64e-4c39-9014-2e9483726629 tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:08:45.365017 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-13790b64-a64e-4c39-9014-2e9483726629 tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:08:45.455908 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-96ba5a57-c631-4f10-a782-faea4528be3e tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e9707561b4a4811bd7a7d3fed4fcd6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da99a87350634e9ea8a89f314f5e6118', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:08:45.459595 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-96ba5a57-c631-4f10-a782-faea4528be3e tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] 10.222.0.20 "GET /compute/v2.1/servers/246ef166-ec68-4657-b7b2-529c41cb4429" status: 200 len: 1278 microversion: 2.1 time: 0.158723 Jul 01 04:08:45.460196 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 221/435] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:08:45 2022] GET /compute/v2.1/servers/246ef166-ec68-4657-b7b2-529c41cb4429 => generated 1278 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:08:45.508644 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-13790b64-a64e-4c39-9014-2e9483726629 tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021817b0eef94fc2a19d90c511ec9298', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87ca5d9f50847d6ab501ca3a51ab37c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:08:45.519533 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-13790b64-a64e-4c39-9014-2e9483726629 tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] 10.222.0.20 "GET /compute/v2.1/servers/16079191-5fa2-4add-8134-bf7d18446a6a" status: 200 len: 1513 microversion: 2.1 time: 0.169283 Jul 01 04:08:45.520175 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 215/436] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:08:45 2022] GET /compute/v2.1/servers/16079191-5fa2-4add-8134-bf7d18446a6a => generated 1513 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:08:45.653123 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-07ab23d6-3b4e-4637-83b7-a1dffa5f9d8e tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:08:45.653703 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-07ab23d6-3b4e-4637-83b7-a1dffa5f9d8e tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] [instance: 1f96263a-e229-447e-aa6b-dd9c2872c751] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:08:45.659841 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-07ab23d6-3b4e-4637-83b7-a1dffa5f9d8e tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:08:45.660295 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-07ab23d6-3b4e-4637-83b7-a1dffa5f9d8e tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:08:45.661067 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-07ab23d6-3b4e-4637-83b7-a1dffa5f9d8e tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:08:45.661521 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-07ab23d6-3b4e-4637-83b7-a1dffa5f9d8e tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:08:45.796051 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-07ab23d6-3b4e-4637-83b7-a1dffa5f9d8e tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8622ec5212c84d87b9b7c8f725012a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0143140d4f649478e36abcee284640c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:08:45.804689 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-07ab23d6-3b4e-4637-83b7-a1dffa5f9d8e tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] 10.222.0.20 "GET /compute/v2.1/servers/1f96263a-e229-447e-aa6b-dd9c2872c751" status: 200 len: 1736 microversion: 2.1 time: 0.156419 Jul 01 04:08:45.805383 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 222/437] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:08:45 2022] GET /compute/v2.1/servers/1f96263a-e229-447e-aa6b-dd9c2872c751 => generated 1736 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:08:46.477037 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-5373b5e8-b4fc-43ba-bd6b-4d90ad4641fc tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:08:46.477736 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-5373b5e8-b4fc-43ba-bd6b-4d90ad4641fc tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] [instance: 246ef166-ec68-4657-b7b2-529c41cb4429] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:08:46.490760 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-5373b5e8-b4fc-43ba-bd6b-4d90ad4641fc tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:08:46.491477 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-5373b5e8-b4fc-43ba-bd6b-4d90ad4641fc tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:08:46.498248 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-5373b5e8-b4fc-43ba-bd6b-4d90ad4641fc tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:08:46.498837 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-5373b5e8-b4fc-43ba-bd6b-4d90ad4641fc tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:08:46.538854 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-f03f7808-3cb3-43e3-9ccd-1f6499c5dff0 tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:08:46.539633 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-f03f7808-3cb3-43e3-9ccd-1f6499c5dff0 tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] [instance: 16079191-5fa2-4add-8134-bf7d18446a6a] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:08:46.555595 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-f03f7808-3cb3-43e3-9ccd-1f6499c5dff0 tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:08:46.555595 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-f03f7808-3cb3-43e3-9ccd-1f6499c5dff0 tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:08:46.555595 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-f03f7808-3cb3-43e3-9ccd-1f6499c5dff0 tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:08:46.555595 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-f03f7808-3cb3-43e3-9ccd-1f6499c5dff0 tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:08:46.710506 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-f03f7808-3cb3-43e3-9ccd-1f6499c5dff0 tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021817b0eef94fc2a19d90c511ec9298', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87ca5d9f50847d6ab501ca3a51ab37c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:08:46.722216 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-f03f7808-3cb3-43e3-9ccd-1f6499c5dff0 tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] 10.222.0.20 "GET /compute/v2.1/servers/16079191-5fa2-4add-8134-bf7d18446a6a" status: 200 len: 1513 microversion: 2.1 time: 0.188029 Jul 01 04:08:46.722976 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 223/438] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:08:46 2022] GET /compute/v2.1/servers/16079191-5fa2-4add-8134-bf7d18446a6a => generated 1513 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 04:08:46.816499 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-5373b5e8-b4fc-43ba-bd6b-4d90ad4641fc tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e9707561b4a4811bd7a7d3fed4fcd6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da99a87350634e9ea8a89f314f5e6118', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:08:46.823781 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-ccc31f04-1fa2-4ba2-bcb4-ab3c20949e7b tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:08:46.824543 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-ccc31f04-1fa2-4ba2-bcb4-ab3c20949e7b tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] [instance: 1f96263a-e229-447e-aa6b-dd9c2872c751] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:08:46.824994 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-5373b5e8-b4fc-43ba-bd6b-4d90ad4641fc tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] 10.222.0.20 "GET /compute/v2.1/servers/246ef166-ec68-4657-b7b2-529c41cb4429" status: 200 len: 1266 microversion: 2.1 time: 0.351769 Jul 01 04:08:46.826053 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 216/439] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:08:46 2022] GET /compute/v2.1/servers/246ef166-ec68-4657-b7b2-529c41cb4429 => generated 1266 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:08:46.831785 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-ccc31f04-1fa2-4ba2-bcb4-ab3c20949e7b tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:08:46.832367 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-ccc31f04-1fa2-4ba2-bcb4-ab3c20949e7b tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:08:46.833243 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-ccc31f04-1fa2-4ba2-bcb4-ab3c20949e7b tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:08:46.833873 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-ccc31f04-1fa2-4ba2-bcb4-ab3c20949e7b tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:08:46.954320 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [req-5a8ed903-307c-41eb-bf0f-5fb895e50631 req-cf83d6ee-acc7-4b71-840b-dcc550ef9ac2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "246ef166-ec68-4657-b7b2-529c41cb4429", "tag": "706047c1-eb46-4189-838b-5b3bd921b5c5"}]} {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 04:08:46.968302 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [req-5a8ed903-307c-41eb-bf0f-5fb895e50631 req-cf83d6ee-acc7-4b71-840b-dcc550ef9ac2 service nova] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:08:46.969062 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [req-5a8ed903-307c-41eb-bf0f-5fb895e50631 req-cf83d6ee-acc7-4b71-840b-dcc550ef9ac2 service nova] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:08:46.990168 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.compute.server_external_events [req-5a8ed903-307c-41eb-bf0f-5fb895e50631 req-cf83d6ee-acc7-4b71-840b-dcc550ef9ac2 service nova] Creating event network-changed:706047c1-eb46-4189-838b-5b3bd921b5c5 for instance 246ef166-ec68-4657-b7b2-529c41cb4429 on hv-cinder-84684 Jul 01 04:08:46.999741 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [req-5a8ed903-307c-41eb-bf0f-5fb895e50631 req-cf83d6ee-acc7-4b71-840b-dcc550ef9ac2 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052856 Jul 01 04:08:47.003684 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 217/440] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Jul 1 04:08:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 01 04:08:47.032450 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-ccc31f04-1fa2-4ba2-bcb4-ab3c20949e7b tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8622ec5212c84d87b9b7c8f725012a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0143140d4f649478e36abcee284640c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:08:47.043837 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG dbcounter [-] [118712] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=118712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:08:47.052589 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-ccc31f04-1fa2-4ba2-bcb4-ab3c20949e7b tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] 10.222.0.20 "GET /compute/v2.1/servers/1f96263a-e229-447e-aa6b-dd9c2872c751" status: 200 len: 1736 microversion: 2.1 time: 0.233347 Jul 01 04:08:47.055128 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 224/441] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:08:46 2022] GET /compute/v2.1/servers/1f96263a-e229-447e-aa6b-dd9c2872c751 => generated 1736 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:08:47.744428 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-b05b3309-5a40-4039-a5f2-28badd38fc2e tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:08:47.745157 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-b05b3309-5a40-4039-a5f2-28badd38fc2e tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] [instance: 16079191-5fa2-4add-8134-bf7d18446a6a] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:08:47.751675 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-b05b3309-5a40-4039-a5f2-28badd38fc2e tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:08:47.752065 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-b05b3309-5a40-4039-a5f2-28badd38fc2e tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:08:47.752841 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-b05b3309-5a40-4039-a5f2-28badd38fc2e tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:08:47.753277 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-b05b3309-5a40-4039-a5f2-28badd38fc2e tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:08:47.787112 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-b05b3309-5a40-4039-a5f2-28badd38fc2e tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:08:47.787600 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-b05b3309-5a40-4039-a5f2-28badd38fc2e tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:08:47.788054 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.objects.instance [None req-b05b3309-5a40-4039-a5f2-28badd38fc2e tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Lazy-loading 'fault' on Instance uuid 16079191-5fa2-4add-8134-bf7d18446a6a {{(pid=118711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 04:08:47.836822 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-b05b3309-5a40-4039-a5f2-28badd38fc2e tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021817b0eef94fc2a19d90c511ec9298', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87ca5d9f50847d6ab501ca3a51ab37c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:08:47.846128 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-ec5eecbe-6302-486a-b6e0-458aca33af82 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:08:47.847180 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-ec5eecbe-6302-486a-b6e0-458aca33af82 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] [instance: 246ef166-ec68-4657-b7b2-529c41cb4429] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:08:47.850080 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-b05b3309-5a40-4039-a5f2-28badd38fc2e tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] 10.222.0.20 "GET /compute/v2.1/servers/16079191-5fa2-4add-8134-bf7d18446a6a" status: 200 len: 1309 microversion: 2.1 time: 0.110059 Jul 01 04:08:47.851013 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 218/442] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:08:47 2022] GET /compute/v2.1/servers/16079191-5fa2-4add-8134-bf7d18446a6a => generated 1309 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:08:47.856499 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-ec5eecbe-6302-486a-b6e0-458aca33af82 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:08:47.856949 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-ec5eecbe-6302-486a-b6e0-458aca33af82 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:08:47.857728 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-ec5eecbe-6302-486a-b6e0-458aca33af82 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:08:47.858166 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-ec5eecbe-6302-486a-b6e0-458aca33af82 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:08:48.014235 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-ec5eecbe-6302-486a-b6e0-458aca33af82 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e9707561b4a4811bd7a7d3fed4fcd6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da99a87350634e9ea8a89f314f5e6118', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:08:48.021654 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-ec5eecbe-6302-486a-b6e0-458aca33af82 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] 10.222.0.20 "GET /compute/v2.1/servers/246ef166-ec68-4657-b7b2-529c41cb4429" status: 200 len: 1266 microversion: 2.1 time: 0.182265 Jul 01 04:08:48.031092 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 225/443] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:08:47 2022] GET /compute/v2.1/servers/246ef166-ec68-4657-b7b2-529c41cb4429 => generated 1266 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 04:08:48.076124 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-8179ef3b-51dc-44ef-835b-7661778c67cc tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:08:48.077431 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-8179ef3b-51dc-44ef-835b-7661778c67cc tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] [instance: 1f96263a-e229-447e-aa6b-dd9c2872c751] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:08:48.096059 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-8179ef3b-51dc-44ef-835b-7661778c67cc tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:08:48.096059 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-8179ef3b-51dc-44ef-835b-7661778c67cc tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:08:48.096059 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-8179ef3b-51dc-44ef-835b-7661778c67cc tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:08:48.096059 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-8179ef3b-51dc-44ef-835b-7661778c67cc tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:08:48.259838 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-8179ef3b-51dc-44ef-835b-7661778c67cc tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8622ec5212c84d87b9b7c8f725012a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0143140d4f649478e36abcee284640c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:08:48.269330 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-8179ef3b-51dc-44ef-835b-7661778c67cc tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] 10.222.0.20 "GET /compute/v2.1/servers/1f96263a-e229-447e-aa6b-dd9c2872c751" status: 200 len: 1736 microversion: 2.1 time: 0.200674 Jul 01 04:08:48.272405 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 219/444] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:08:48 2022] GET /compute/v2.1/servers/1f96263a-e229-447e-aa6b-dd9c2872c751 => generated 1736 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:08:48.868733 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-97878a85-2acc-4cb9-a96e-a5485586a6ad tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:08:48.869264 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-97878a85-2acc-4cb9-a96e-a5485586a6ad tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] [instance: 16079191-5fa2-4add-8134-bf7d18446a6a] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:08:48.876774 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-97878a85-2acc-4cb9-a96e-a5485586a6ad tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:08:48.877235 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-97878a85-2acc-4cb9-a96e-a5485586a6ad tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:08:48.878044 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-97878a85-2acc-4cb9-a96e-a5485586a6ad tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:08:48.878525 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-97878a85-2acc-4cb9-a96e-a5485586a6ad tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:08:48.894843 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.wsgi [None req-97878a85-2acc-4cb9-a96e-a5485586a6ad tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] HTTP exception thrown: Instance 16079191-5fa2-4add-8134-bf7d18446a6a could not be found. Jul 01 04:08:48.896536 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-97878a85-2acc-4cb9-a96e-a5485586a6ad tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Request method failure captured: Jul 01 04:08:48.896536 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: request: GET /compute/v2.1/servers/16079191-5fa2-4add-8134-bf7d18446a6a HTTP/1.1 Jul 01 04:08:48.896536 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: Accept: application/json Jul 01 04:08:48.896536 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: Accept-Encoding: identity Jul 01 04:08:48.896536 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: Connection: close Jul 01 04:08:48.896536 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: Content-Length: 0 Jul 01 04:08:48.896536 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: Content-Type: application/json Jul 01 04:08:48.896536 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: Host: 10.222.0.20 Jul 01 04:08:48.896536 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: Openstack-System-Scope: None Jul 01 04:08:48.896536 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: User-Agent: python-urllib3/1.26.9 Jul 01 04:08:48.896536 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Auth-Token: gAAAAABivnLg3JvkEP6c_-cbMGwLFF7GaPdZAi6_U98zlw0cn-k-JJhA0Ae4BmEHRgF2YQqevLpog3fS4AN0TxQ0_wy-BAX8T7vQtlaxpLtoXFEDJ9TCSsLqPDiFml_aNWrQjTDq7VSoYNdYi_N7wolC3KYyMrACv_5100qxhY89eNe32W4ke1w Jul 01 04:08:48.896536 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Domain-Id: None Jul 01 04:08:48.896536 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Domain-Name: None Jul 01 04:08:48.896536 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Identity-Status: Confirmed Jul 01 04:08:48.896536 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Is-Admin-Project: True Jul 01 04:08:48.896536 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Project-Domain-Id: default Jul 01 04:08:48.896536 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Project-Domain-Name: Default Jul 01 04:08:48.896536 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Project-Id: e87ca5d9f50847d6ab501ca3a51ab37c Jul 01 04:08:48.896536 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Project-Name: tempest-VolumesSnapshotTestJSON-350761947 Jul 01 04:08:48.896536 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Role: reader,member Jul 01 04:08:48.896536 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Roles: reader,member Jul 01 04:08:48.898156 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/e87ca5d9f50847d6ab501ca3a51ab37c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_e87ca5d9f50847d6ab501ca3a51ab37c", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e87ca5d9f50847d6ab501ca3a51ab37c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e87ca5d9f50847d6ab501ca3a51ab37c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}] Jul 01 04:08:48.898156 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Tenant: tempest-VolumesSnapshotTestJSON-350761947 Jul 01 04:08:48.898156 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Tenant-Id: e87ca5d9f50847d6ab501ca3a51ab37c Jul 01 04:08:48.898156 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-350761947 Jul 01 04:08:48.898156 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-User: tempest-VolumesSnapshotTestJSON-350761947-project Jul 01 04:08:48.898156 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-User-Domain-Id: default Jul 01 04:08:48.898156 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-User-Domain-Name: Default Jul 01 04:08:48.898156 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-User-Id: 021817b0eef94fc2a19d90c511ec9298 Jul 01 04:08:48.898156 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-User-Name: tempest-VolumesSnapshotTestJSON-350761947-project Jul 01 04:08:48.898156 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: method: > Jul 01 04:08:48.898156 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: exception: Instance 16079191-5fa2-4add-8134-bf7d18446a6a could not be found. Jul 01 04:08:48.898156 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: action_args: {'id': '16079191-5fa2-4add-8134-bf7d18446a6a'} Jul 01 04:08:48.899110 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 04:08:48.899110 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 04:08:48.899110 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 04:08:48.899110 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 04:08:48.899110 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 04:08:48.899110 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 04:08:48.899110 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 04:08:48.899110 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 04:08:48.899110 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 04:08:48.899110 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 04:08:48.899110 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 16079191-5fa2-4add-8134-bf7d18446a6a could not be found. Jul 01 04:08:48.899110 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi Jul 01 04:08:48.899110 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 04:08:48.899110 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi Jul 01 04:08:48.899110 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 04:08:48.899110 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 04:08:48.899110 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 04:08:48.899110 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 04:08:48.899110 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 04:08:48.899110 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 04:08:48.900765 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 04:08:48.900765 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 04:08:48.900765 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 04:08:48.900765 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 04:08:48.900765 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 04:08:48.900765 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 04:08:48.900765 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 04:08:48.900765 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 16079191-5fa2-4add-8134-bf7d18446a6a could not be found. Jul 01 04:08:48.900765 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi Jul 01 04:08:48.900765 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 04:08:48.900765 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi Jul 01 04:08:48.900765 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 04:08:48.900765 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 04:08:48.900765 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 04:08:48.900765 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 04:08:48.900765 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 04:08:48.900765 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 16079191-5fa2-4add-8134-bf7d18446a6a could not be found. Jul 01 04:08:48.900765 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi Jul 01 04:08:48.902092 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-97878a85-2acc-4cb9-a96e-a5485586a6ad tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Returning 404 to user: Instance 16079191-5fa2-4add-8134-bf7d18446a6a could not be found. {{(pid=118712) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 04:08:48.902092 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-97878a85-2acc-4cb9-a96e-a5485586a6ad tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] 10.222.0.20 "GET /compute/v2.1/servers/16079191-5fa2-4add-8134-bf7d18446a6a" status: 404 len: 111 microversion: 2.1 time: 0.033294 Jul 01 04:08:48.902092 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 226/445] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:08:48 2022] GET /compute/v2.1/servers/16079191-5fa2-4add-8134-bf7d18446a6a => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 04:08:49.017252 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [req-a44b1f56-cfe0-4bd5-a820-24d9b665fbea req-7bec9a65-51c5-4260-a511-4e99a4479937 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16079191-5fa2-4add-8134-bf7d18446a6a", "name": "network-vif-deleted", "tag": "6c8a3556-dbf6-4a9c-a921-5f5d03d9714c"}]} {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 04:08:49.027198 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [req-a44b1f56-cfe0-4bd5-a820-24d9b665fbea req-7bec9a65-51c5-4260-a511-4e99a4479937 service nova] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:08:49.027792 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [req-a44b1f56-cfe0-4bd5-a820-24d9b665fbea req-7bec9a65-51c5-4260-a511-4e99a4479937 service nova] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:08:49.039617 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.compute.server_external_events [req-a44b1f56-cfe0-4bd5-a820-24d9b665fbea req-7bec9a65-51c5-4260-a511-4e99a4479937 service nova] Creating event network-vif-deleted:6c8a3556-dbf6-4a9c-a921-5f5d03d9714c for instance 16079191-5fa2-4add-8134-bf7d18446a6a on hv-cinder-84684 Jul 01 04:08:49.040270 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-e141ed2d-5b6a-4126-8911-f36788b90e32 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:08:49.041101 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-e141ed2d-5b6a-4126-8911-f36788b90e32 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] [instance: 246ef166-ec68-4657-b7b2-529c41cb4429] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:08:49.045533 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [req-a44b1f56-cfe0-4bd5-a820-24d9b665fbea req-7bec9a65-51c5-4260-a511-4e99a4479937 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032045 Jul 01 04:08:49.046452 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 220/446] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Jul 1 04:08:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 04:08:49.048864 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-e141ed2d-5b6a-4126-8911-f36788b90e32 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:08:49.050399 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-e141ed2d-5b6a-4126-8911-f36788b90e32 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:08:49.050399 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-e141ed2d-5b6a-4126-8911-f36788b90e32 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:08:49.050399 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-e141ed2d-5b6a-4126-8911-f36788b90e32 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:08:49.209105 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-e141ed2d-5b6a-4126-8911-f36788b90e32 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e9707561b4a4811bd7a7d3fed4fcd6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da99a87350634e9ea8a89f314f5e6118', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:08:49.216754 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-e141ed2d-5b6a-4126-8911-f36788b90e32 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] 10.222.0.20 "GET /compute/v2.1/servers/246ef166-ec68-4657-b7b2-529c41cb4429" status: 200 len: 1266 microversion: 2.1 time: 0.181089 Jul 01 04:08:49.217336 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 227/447] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:08:49 2022] GET /compute/v2.1/servers/246ef166-ec68-4657-b7b2-529c41cb4429 => generated 1266 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 04:08:49.290830 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-1637e5e0-2169-4864-8781-9eb68609a774 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:08:49.291601 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-1637e5e0-2169-4864-8781-9eb68609a774 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] [instance: 1f96263a-e229-447e-aa6b-dd9c2872c751] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:08:49.294197 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG dbcounter [-] [118711] Writing DB stats nova_cell0:SELECT=2 {{(pid=118711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:08:49.294920 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG dbcounter [-] [118711] Writing DB stats nova_cell0:SELECT=6 {{(pid=118711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:08:49.300410 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-1637e5e0-2169-4864-8781-9eb68609a774 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:08:49.300869 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-1637e5e0-2169-4864-8781-9eb68609a774 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:08:49.301662 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-1637e5e0-2169-4864-8781-9eb68609a774 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:08:49.302094 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-1637e5e0-2169-4864-8781-9eb68609a774 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:08:49.323520 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG dbcounter [-] [118711] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=118711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:08:49.457188 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-1637e5e0-2169-4864-8781-9eb68609a774 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8622ec5212c84d87b9b7c8f725012a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0143140d4f649478e36abcee284640c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:08:49.468292 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-1637e5e0-2169-4864-8781-9eb68609a774 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] 10.222.0.20 "GET /compute/v2.1/servers/1f96263a-e229-447e-aa6b-dd9c2872c751" status: 200 len: 1736 microversion: 2.1 time: 0.181764 Jul 01 04:08:49.468891 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 221/448] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:08:49 2022] GET /compute/v2.1/servers/1f96263a-e229-447e-aa6b-dd9c2872c751 => generated 1736 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:08:50.234446 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-d4ff3a0a-03b7-48b1-9894-fa9175ce442c tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:08:50.237158 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-d4ff3a0a-03b7-48b1-9894-fa9175ce442c tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] [instance: 246ef166-ec68-4657-b7b2-529c41cb4429] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:08:50.242182 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-d4ff3a0a-03b7-48b1-9894-fa9175ce442c tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:08:50.242645 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-d4ff3a0a-03b7-48b1-9894-fa9175ce442c tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:08:50.243516 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-d4ff3a0a-03b7-48b1-9894-fa9175ce442c tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:08:50.243932 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-d4ff3a0a-03b7-48b1-9894-fa9175ce442c tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:08:50.400025 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-d4ff3a0a-03b7-48b1-9894-fa9175ce442c tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e9707561b4a4811bd7a7d3fed4fcd6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da99a87350634e9ea8a89f314f5e6118', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:08:50.414164 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-d4ff3a0a-03b7-48b1-9894-fa9175ce442c tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] 10.222.0.20 "GET /compute/v2.1/servers/246ef166-ec68-4657-b7b2-529c41cb4429" status: 200 len: 1266 microversion: 2.1 time: 0.183132 Jul 01 04:08:50.416007 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 228/449] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:08:50 2022] GET /compute/v2.1/servers/246ef166-ec68-4657-b7b2-529c41cb4429 => generated 1266 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 04:08:50.487009 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-bcc7c725-a6f0-4e58-8df4-845b648a5c44 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:08:50.487667 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-bcc7c725-a6f0-4e58-8df4-845b648a5c44 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] [instance: 1f96263a-e229-447e-aa6b-dd9c2872c751] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:08:50.496437 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-bcc7c725-a6f0-4e58-8df4-845b648a5c44 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:08:50.496938 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-bcc7c725-a6f0-4e58-8df4-845b648a5c44 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:08:50.497795 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-bcc7c725-a6f0-4e58-8df4-845b648a5c44 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:08:50.498353 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-bcc7c725-a6f0-4e58-8df4-845b648a5c44 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:08:50.670073 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-bcc7c725-a6f0-4e58-8df4-845b648a5c44 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8622ec5212c84d87b9b7c8f725012a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0143140d4f649478e36abcee284640c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:08:50.678713 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-bcc7c725-a6f0-4e58-8df4-845b648a5c44 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] 10.222.0.20 "GET /compute/v2.1/servers/1f96263a-e229-447e-aa6b-dd9c2872c751" status: 200 len: 1736 microversion: 2.1 time: 0.195897 Jul 01 04:08:50.679202 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 222/450] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:08:50 2022] GET /compute/v2.1/servers/1f96263a-e229-447e-aa6b-dd9c2872c751 => generated 1736 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:08:51.433551 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-0dc58859-ef38-4c4f-9d14-e96962a95c09 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:08:51.434206 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-0dc58859-ef38-4c4f-9d14-e96962a95c09 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] [instance: 246ef166-ec68-4657-b7b2-529c41cb4429] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:08:51.436498 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG dbcounter [-] [118712] Writing DB stats nova_cell0:SELECT=4 {{(pid=118712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:08:51.442730 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-0dc58859-ef38-4c4f-9d14-e96962a95c09 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:08:51.443196 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-0dc58859-ef38-4c4f-9d14-e96962a95c09 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:08:51.444019 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-0dc58859-ef38-4c4f-9d14-e96962a95c09 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:08:51.444460 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-0dc58859-ef38-4c4f-9d14-e96962a95c09 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:08:51.626751 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-0dc58859-ef38-4c4f-9d14-e96962a95c09 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e9707561b4a4811bd7a7d3fed4fcd6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da99a87350634e9ea8a89f314f5e6118', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:08:51.635042 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-0dc58859-ef38-4c4f-9d14-e96962a95c09 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] 10.222.0.20 "GET /compute/v2.1/servers/246ef166-ec68-4657-b7b2-529c41cb4429" status: 200 len: 1266 microversion: 2.1 time: 0.205761 Jul 01 04:08:51.636365 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 229/451] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:08:51 2022] GET /compute/v2.1/servers/246ef166-ec68-4657-b7b2-529c41cb4429 => generated 1266 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:08:51.699527 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-d87e9320-e740-4554-befa-d103d2b0a19b tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:08:51.700784 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-d87e9320-e740-4554-befa-d103d2b0a19b tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] [instance: 1f96263a-e229-447e-aa6b-dd9c2872c751] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:08:51.707823 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-d87e9320-e740-4554-befa-d103d2b0a19b tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:08:51.708280 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-d87e9320-e740-4554-befa-d103d2b0a19b tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:08:51.709076 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-d87e9320-e740-4554-befa-d103d2b0a19b tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:08:51.709519 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-d87e9320-e740-4554-befa-d103d2b0a19b tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:08:51.862841 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-d87e9320-e740-4554-befa-d103d2b0a19b tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8622ec5212c84d87b9b7c8f725012a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0143140d4f649478e36abcee284640c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:08:51.871725 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-d87e9320-e740-4554-befa-d103d2b0a19b tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] 10.222.0.20 "GET /compute/v2.1/servers/1f96263a-e229-447e-aa6b-dd9c2872c751" status: 200 len: 1736 microversion: 2.1 time: 0.178359 Jul 01 04:08:51.882949 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 223/452] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:08:51 2022] GET /compute/v2.1/servers/1f96263a-e229-447e-aa6b-dd9c2872c751 => generated 1736 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 04:08:52.655604 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-9321aee0-0769-4094-a72e-b37292ea1ca9 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:08:52.656437 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-9321aee0-0769-4094-a72e-b37292ea1ca9 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] [instance: 246ef166-ec68-4657-b7b2-529c41cb4429] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:08:52.662879 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-9321aee0-0769-4094-a72e-b37292ea1ca9 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:08:52.663529 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-9321aee0-0769-4094-a72e-b37292ea1ca9 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:08:52.664350 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-9321aee0-0769-4094-a72e-b37292ea1ca9 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:08:52.664788 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-9321aee0-0769-4094-a72e-b37292ea1ca9 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:08:52.815842 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-9321aee0-0769-4094-a72e-b37292ea1ca9 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e9707561b4a4811bd7a7d3fed4fcd6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da99a87350634e9ea8a89f314f5e6118', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:08:52.825247 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-9321aee0-0769-4094-a72e-b37292ea1ca9 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] 10.222.0.20 "GET /compute/v2.1/servers/246ef166-ec68-4657-b7b2-529c41cb4429" status: 200 len: 1266 microversion: 2.1 time: 0.175010 Jul 01 04:08:52.826100 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 230/453] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:08:52 2022] GET /compute/v2.1/servers/246ef166-ec68-4657-b7b2-529c41cb4429 => generated 1266 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 04:08:52.891004 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-329cb34d-cfae-4595-b42b-e8ebfbc501c0 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:08:52.891653 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-329cb34d-cfae-4595-b42b-e8ebfbc501c0 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] [instance: 1f96263a-e229-447e-aa6b-dd9c2872c751] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:08:52.898581 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-329cb34d-cfae-4595-b42b-e8ebfbc501c0 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:08:52.899034 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-329cb34d-cfae-4595-b42b-e8ebfbc501c0 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:08:52.899851 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-329cb34d-cfae-4595-b42b-e8ebfbc501c0 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:08:52.900494 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-329cb34d-cfae-4595-b42b-e8ebfbc501c0 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:08:53.062898 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-329cb34d-cfae-4595-b42b-e8ebfbc501c0 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8622ec5212c84d87b9b7c8f725012a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0143140d4f649478e36abcee284640c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:08:53.065264 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-329cb34d-cfae-4595-b42b-e8ebfbc501c0 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] 10.222.0.20 "GET /compute/v2.1/servers/1f96263a-e229-447e-aa6b-dd9c2872c751" status: 200 len: 1736 microversion: 2.1 time: 0.177793 Jul 01 04:08:53.066062 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 224/454] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:08:52 2022] GET /compute/v2.1/servers/1f96263a-e229-447e-aa6b-dd9c2872c751 => generated 1736 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:08:53.844145 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-513fd29e-9f86-4539-93bc-f1e4f57bcf77 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:08:53.845084 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-513fd29e-9f86-4539-93bc-f1e4f57bcf77 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] [instance: 246ef166-ec68-4657-b7b2-529c41cb4429] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:08:53.852229 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-513fd29e-9f86-4539-93bc-f1e4f57bcf77 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:08:53.852690 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-513fd29e-9f86-4539-93bc-f1e4f57bcf77 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:08:53.853480 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-513fd29e-9f86-4539-93bc-f1e4f57bcf77 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:08:53.853922 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-513fd29e-9f86-4539-93bc-f1e4f57bcf77 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:08:54.034642 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-513fd29e-9f86-4539-93bc-f1e4f57bcf77 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e9707561b4a4811bd7a7d3fed4fcd6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da99a87350634e9ea8a89f314f5e6118', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:08:54.044028 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-513fd29e-9f86-4539-93bc-f1e4f57bcf77 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] 10.222.0.20 "GET /compute/v2.1/servers/246ef166-ec68-4657-b7b2-529c41cb4429" status: 200 len: 1266 microversion: 2.1 time: 0.204001 Jul 01 04:08:54.044903 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 231/455] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:08:53 2022] GET /compute/v2.1/servers/246ef166-ec68-4657-b7b2-529c41cb4429 => generated 1266 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:08:54.087925 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-d045212e-436b-4664-9adf-6f451e0b8d81 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:08:54.088538 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-d045212e-436b-4664-9adf-6f451e0b8d81 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] [instance: 1f96263a-e229-447e-aa6b-dd9c2872c751] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:08:54.096311 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-d045212e-436b-4664-9adf-6f451e0b8d81 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:08:54.096774 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-d045212e-436b-4664-9adf-6f451e0b8d81 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:08:54.097543 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-d045212e-436b-4664-9adf-6f451e0b8d81 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:08:54.097967 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-d045212e-436b-4664-9adf-6f451e0b8d81 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:08:54.240821 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-d045212e-436b-4664-9adf-6f451e0b8d81 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8622ec5212c84d87b9b7c8f725012a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0143140d4f649478e36abcee284640c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:08:54.250918 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-d045212e-436b-4664-9adf-6f451e0b8d81 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] 10.222.0.20 "GET /compute/v2.1/servers/1f96263a-e229-447e-aa6b-dd9c2872c751" status: 200 len: 1736 microversion: 2.1 time: 0.166382 Jul 01 04:08:54.251515 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 225/456] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:08:54 2022] GET /compute/v2.1/servers/1f96263a-e229-447e-aa6b-dd9c2872c751 => generated 1736 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:08:54.293595 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-23dfb490-d662-499a-ab18-82b6d54e6797 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 04:08:54.295712 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-23dfb490-d662-499a-ab18-82b6d54e6797 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] [instance: 30391772-c0aa-468b-a414-c40c716a2481] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:08:54.306445 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-23dfb490-d662-499a-ab18-82b6d54e6797 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:08:54.308180 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-23dfb490-d662-499a-ab18-82b6d54e6797 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:08:54.312629 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-23dfb490-d662-499a-ab18-82b6d54e6797 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:08:54.312629 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-23dfb490-d662-499a-ab18-82b6d54e6797 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:08:54.577227 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-23dfb490-d662-499a-ab18-82b6d54e6797 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] 10.222.0.20 "POST /compute/v2.1/servers/30391772-c0aa-468b-a414-c40c716a2481/action" status: 202 len: 0 microversion: 2.1 time: 0.291394 Jul 01 04:08:54.579366 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 232/457] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Jul 1 04:08:54 2022] POST /compute/v2.1/servers/30391772-c0aa-468b-a414-c40c716a2481/action => generated 0 bytes in 293 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 04:08:54.586747 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-57f4e740-bab6-4da0-8b33-cdcf8cb130a0 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:08:54.587405 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-57f4e740-bab6-4da0-8b33-cdcf8cb130a0 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] [instance: 30391772-c0aa-468b-a414-c40c716a2481] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:08:54.593500 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-57f4e740-bab6-4da0-8b33-cdcf8cb130a0 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:08:54.593972 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-57f4e740-bab6-4da0-8b33-cdcf8cb130a0 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:08:54.594723 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-57f4e740-bab6-4da0-8b33-cdcf8cb130a0 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:08:54.595159 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-57f4e740-bab6-4da0-8b33-cdcf8cb130a0 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:08:54.759048 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-57f4e740-bab6-4da0-8b33-cdcf8cb130a0 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abc2e04754884398afc999d423e2a711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2940ca71c4b24b5facc194b61d748a11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:08:54.768605 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-57f4e740-bab6-4da0-8b33-cdcf8cb130a0 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] 10.222.0.20 "GET /compute/v2.1/servers/30391772-c0aa-468b-a414-c40c716a2481" status: 200 len: 1751 microversion: 2.1 time: 0.185646 Jul 01 04:08:54.769809 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 226/458] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:08:54 2022] GET /compute/v2.1/servers/30391772-c0aa-468b-a414-c40c716a2481 => generated 1751 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 04:08:55.064082 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-e20742a9-6910-40c0-b1a6-67b625aefd58 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:08:55.065212 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-e20742a9-6910-40c0-b1a6-67b625aefd58 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] [instance: 246ef166-ec68-4657-b7b2-529c41cb4429] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:08:55.072861 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-e20742a9-6910-40c0-b1a6-67b625aefd58 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:08:55.073966 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-e20742a9-6910-40c0-b1a6-67b625aefd58 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:08:55.074768 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-e20742a9-6910-40c0-b1a6-67b625aefd58 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:08:55.076449 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-e20742a9-6910-40c0-b1a6-67b625aefd58 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:08:55.248597 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-e20742a9-6910-40c0-b1a6-67b625aefd58 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e9707561b4a4811bd7a7d3fed4fcd6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da99a87350634e9ea8a89f314f5e6118', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:08:55.257991 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-e20742a9-6910-40c0-b1a6-67b625aefd58 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] 10.222.0.20 "GET /compute/v2.1/servers/246ef166-ec68-4657-b7b2-529c41cb4429" status: 200 len: 1266 microversion: 2.1 time: 0.199056 Jul 01 04:08:55.258877 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 233/459] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:08:55 2022] GET /compute/v2.1/servers/246ef166-ec68-4657-b7b2-529c41cb4429 => generated 1266 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:08:55.274746 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-98b4685d-9470-4a89-8350-b1490e2580ce tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:08:55.277338 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-98b4685d-9470-4a89-8350-b1490e2580ce tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] [instance: 1f96263a-e229-447e-aa6b-dd9c2872c751] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:08:55.288179 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-98b4685d-9470-4a89-8350-b1490e2580ce tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:08:55.288728 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-98b4685d-9470-4a89-8350-b1490e2580ce tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:08:55.289744 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-98b4685d-9470-4a89-8350-b1490e2580ce tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:08:55.290237 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-98b4685d-9470-4a89-8350-b1490e2580ce tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:08:55.599519 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-98b4685d-9470-4a89-8350-b1490e2580ce tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8622ec5212c84d87b9b7c8f725012a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0143140d4f649478e36abcee284640c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:08:55.609533 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-98b4685d-9470-4a89-8350-b1490e2580ce tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] 10.222.0.20 "GET /compute/v2.1/servers/1f96263a-e229-447e-aa6b-dd9c2872c751" status: 200 len: 1736 microversion: 2.1 time: 0.343144 Jul 01 04:08:55.610204 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 227/460] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:08:55 2022] GET /compute/v2.1/servers/1f96263a-e229-447e-aa6b-dd9c2872c751 => generated 1736 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:08:55.786452 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-cb428b8c-3c7b-4992-8140-aaa26a3d250b tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:08:55.787061 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-cb428b8c-3c7b-4992-8140-aaa26a3d250b tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] [instance: 30391772-c0aa-468b-a414-c40c716a2481] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:08:55.793702 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-cb428b8c-3c7b-4992-8140-aaa26a3d250b tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:08:55.794146 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-cb428b8c-3c7b-4992-8140-aaa26a3d250b tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:08:55.794900 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-cb428b8c-3c7b-4992-8140-aaa26a3d250b tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:08:55.795363 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-cb428b8c-3c7b-4992-8140-aaa26a3d250b tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:08:55.952886 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-cb428b8c-3c7b-4992-8140-aaa26a3d250b tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abc2e04754884398afc999d423e2a711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2940ca71c4b24b5facc194b61d748a11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:08:55.961318 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-cb428b8c-3c7b-4992-8140-aaa26a3d250b tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] 10.222.0.20 "GET /compute/v2.1/servers/30391772-c0aa-468b-a414-c40c716a2481" status: 200 len: 1751 microversion: 2.1 time: 0.178618 Jul 01 04:08:55.961910 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 234/461] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:08:55 2022] GET /compute/v2.1/servers/30391772-c0aa-468b-a414-c40c716a2481 => generated 1751 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:08:56.277447 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-f51ad358-c586-463e-802d-e4f01fd5fe78 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:08:56.278076 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-f51ad358-c586-463e-802d-e4f01fd5fe78 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] [instance: 246ef166-ec68-4657-b7b2-529c41cb4429] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:08:56.294289 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-f51ad358-c586-463e-802d-e4f01fd5fe78 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:08:56.304356 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-f51ad358-c586-463e-802d-e4f01fd5fe78 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:08:56.304356 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-f51ad358-c586-463e-802d-e4f01fd5fe78 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:08:56.304356 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-f51ad358-c586-463e-802d-e4f01fd5fe78 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:08:56.631056 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-d9ff77f6-2e8b-40b3-bcdc-14e33fbe0ad4 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:08:56.631788 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-d9ff77f6-2e8b-40b3-bcdc-14e33fbe0ad4 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] [instance: 1f96263a-e229-447e-aa6b-dd9c2872c751] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:08:56.642227 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-d9ff77f6-2e8b-40b3-bcdc-14e33fbe0ad4 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:08:56.643131 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-d9ff77f6-2e8b-40b3-bcdc-14e33fbe0ad4 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:08:56.644718 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-d9ff77f6-2e8b-40b3-bcdc-14e33fbe0ad4 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:08:56.645575 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-d9ff77f6-2e8b-40b3-bcdc-14e33fbe0ad4 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:08:56.763921 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-f51ad358-c586-463e-802d-e4f01fd5fe78 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e9707561b4a4811bd7a7d3fed4fcd6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da99a87350634e9ea8a89f314f5e6118', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:08:56.772627 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-f51ad358-c586-463e-802d-e4f01fd5fe78 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] 10.222.0.20 "GET /compute/v2.1/servers/246ef166-ec68-4657-b7b2-529c41cb4429" status: 200 len: 1266 microversion: 2.1 time: 0.499393 Jul 01 04:08:56.782203 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 228/462] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:08:56 2022] GET /compute/v2.1/servers/246ef166-ec68-4657-b7b2-529c41cb4429 => generated 1266 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:08:56.853064 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-d9ff77f6-2e8b-40b3-bcdc-14e33fbe0ad4 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8622ec5212c84d87b9b7c8f725012a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0143140d4f649478e36abcee284640c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:08:56.864184 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-d9ff77f6-2e8b-40b3-bcdc-14e33fbe0ad4 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] 10.222.0.20 "GET /compute/v2.1/servers/1f96263a-e229-447e-aa6b-dd9c2872c751" status: 200 len: 1716 microversion: 2.1 time: 0.240012 Jul 01 04:08:56.864907 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 235/463] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:08:56 2022] GET /compute/v2.1/servers/1f96263a-e229-447e-aa6b-dd9c2872c751 => generated 1716 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:08:56.980084 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-d4989707-bdee-48dc-a034-392dbb635cae tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:08:56.980709 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-d4989707-bdee-48dc-a034-392dbb635cae tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] [instance: 30391772-c0aa-468b-a414-c40c716a2481] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:08:56.988364 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-d4989707-bdee-48dc-a034-392dbb635cae tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:08:56.988769 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-d4989707-bdee-48dc-a034-392dbb635cae tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:08:56.990030 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-d4989707-bdee-48dc-a034-392dbb635cae tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:08:56.990569 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-d4989707-bdee-48dc-a034-392dbb635cae tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:08:57.000186 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-56b35219-cee1-469c-a041-6708b1469fdd tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:08:57.000841 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-56b35219-cee1-469c-a041-6708b1469fdd tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] [instance: 1f96263a-e229-447e-aa6b-dd9c2872c751] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:08:57.007660 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-56b35219-cee1-469c-a041-6708b1469fdd tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:08:57.009618 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-56b35219-cee1-469c-a041-6708b1469fdd tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:08:57.009618 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-56b35219-cee1-469c-a041-6708b1469fdd tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:08:57.009618 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-56b35219-cee1-469c-a041-6708b1469fdd tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:08:57.186764 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.wsgi [None req-56b35219-cee1-469c-a041-6708b1469fdd tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] HTTP exception thrown: Cannot 'detach_volume' instance 1f96263a-e229-447e-aa6b-dd9c2872c751 while it is in vm_state rescued Jul 01 04:08:57.189014 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-56b35219-cee1-469c-a041-6708b1469fdd tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Request method failure captured: Jul 01 04:08:57.189014 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: request: DELETE /compute/v2.1/servers/1f96263a-e229-447e-aa6b-dd9c2872c751/os-volume_attachments/1aa822c2-aab0-4145-97a3-0137fc264d4e HTTP/1.1 Jul 01 04:08:57.189014 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: Accept: application/json Jul 01 04:08:57.189014 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: Accept-Encoding: identity Jul 01 04:08:57.189014 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: Connection: close Jul 01 04:08:57.189014 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: Content-Length: 0 Jul 01 04:08:57.189014 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: Content-Type: application/json Jul 01 04:08:57.189014 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: Host: 10.222.0.20 Jul 01 04:08:57.189014 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: Openstack-System-Scope: None Jul 01 04:08:57.189014 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: User-Agent: python-urllib3/1.26.9 Jul 01 04:08:57.189014 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Auth-Token: gAAAAABivnJXigIdoKNrWhyC7v2FozD51jph_FSftzrdGxe-ICt_B7b0yUdhaKt3OJM8y8lEmoukGgxdiuXdffo0lQFNFHXOWALzvqer-sv1yOLbbxqWlc2p1ew_CWt-DcVsNFKW9wSaUR95HogWWAUd-o3FI2WtqElzxvPV0N7AryVuGkczdno Jul 01 04:08:57.189014 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Domain-Id: None Jul 01 04:08:57.189014 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Domain-Name: None Jul 01 04:08:57.189014 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Identity-Status: Confirmed Jul 01 04:08:57.189014 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Is-Admin-Project: True Jul 01 04:08:57.189014 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Project-Domain-Id: default Jul 01 04:08:57.189014 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Project-Domain-Name: Default Jul 01 04:08:57.189014 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Project-Id: f0143140d4f649478e36abcee284640c Jul 01 04:08:57.189014 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-508791321 Jul 01 04:08:57.189014 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Role: reader,member Jul 01 04:08:57.189014 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Roles: reader,member Jul 01 04:08:57.190941 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/f0143140d4f649478e36abcee284640c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_f0143140d4f649478e36abcee284640c", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f0143140d4f649478e36abcee284640c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f0143140d4f649478e36abcee284640c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}] Jul 01 04:08:57.190941 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Tenant: tempest-ServerRescueNegativeTestJSON-508791321 Jul 01 04:08:57.190941 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Tenant-Id: f0143140d4f649478e36abcee284640c Jul 01 04:08:57.190941 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-508791321 Jul 01 04:08:57.190941 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-User: tempest-ServerRescueNegativeTestJSON-508791321-project Jul 01 04:08:57.190941 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-User-Domain-Id: default Jul 01 04:08:57.190941 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-User-Domain-Name: Default Jul 01 04:08:57.190941 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-User-Id: 8622ec5212c84d87b9b7c8f725012a07 Jul 01 04:08:57.190941 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-User-Name: tempest-ServerRescueNegativeTestJSON-508791321-project Jul 01 04:08:57.190941 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: method: > Jul 01 04:08:57.190941 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: exception: Cannot 'detach_volume' instance 1f96263a-e229-447e-aa6b-dd9c2872c751 while it is in vm_state rescued Jul 01 04:08:57.192394 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: action_args: {'server_id': '1f96263a-e229-447e-aa6b-dd9c2872c751', 'id': '1aa822c2-aab0-4145-97a3-0137fc264d4e'} Jul 01 04:08:57.192394 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 04:08:57.192394 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 04:08:57.192394 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jul 01 04:08:57.192394 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jul 01 04:08:57.192394 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 01 04:08:57.192394 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 01 04:08:57.192394 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 01 04:08:57.192394 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 01 04:08:57.192394 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 1f96263a-e229-447e-aa6b-dd9c2872c751 in vm_state rescued. Cannot detach_volume while the instance is in this state. Jul 01 04:08:57.192394 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi Jul 01 04:08:57.192394 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 04:08:57.192394 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi Jul 01 04:08:57.192394 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 04:08:57.192394 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 04:08:57.192394 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 04:08:57.192394 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 04:08:57.192394 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 04:08:57.192394 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 04:08:57.192394 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 04:08:57.194846 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jul 01 04:08:57.194846 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 01 04:08:57.194846 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 01 04:08:57.194846 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 01 04:08:57.194846 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 1f96263a-e229-447e-aa6b-dd9c2872c751 while it is in vm_state rescued Jul 01 04:08:57.194846 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi Jul 01 04:08:57.194846 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 04:08:57.194846 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi Jul 01 04:08:57.194846 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 04:08:57.194846 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 04:08:57.194846 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 04:08:57.194846 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 04:08:57.194846 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 04:08:57.194846 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 1f96263a-e229-447e-aa6b-dd9c2872c751 while it is in vm_state rescued Jul 01 04:08:57.194846 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi Jul 01 04:08:57.194846 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-56b35219-cee1-469c-a041-6708b1469fdd tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Returning 409 to user: Cannot 'detach_volume' instance 1f96263a-e229-447e-aa6b-dd9c2872c751 while it is in vm_state rescued {{(pid=118712) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 04:08:57.199896 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-56b35219-cee1-469c-a041-6708b1469fdd tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] 10.222.0.20 "DELETE /compute/v2.1/servers/1f96263a-e229-447e-aa6b-dd9c2872c751/os-volume_attachments/1aa822c2-aab0-4145-97a3-0137fc264d4e" status: 409 len: 152 microversion: 2.1 time: 0.196322 Jul 01 04:08:57.199896 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 236/464] 10.222.0.20 () {58 vars in 1415 bytes} [Fri Jul 1 04:08:56 2022] DELETE /compute/v2.1/servers/1f96263a-e229-447e-aa6b-dd9c2872c751/os-volume_attachments/1aa822c2-aab0-4145-97a3-0137fc264d4e => generated 152 bytes in 201 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Jul 01 04:08:57.201571 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-86a13b25-bb54-4162-9656-8af9f5e60a80 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 04:08:57.201710 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-d4989707-bdee-48dc-a034-392dbb635cae tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abc2e04754884398afc999d423e2a711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2940ca71c4b24b5facc194b61d748a11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:08:57.202111 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-86a13b25-bb54-4162-9656-8af9f5e60a80 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] [instance: 1f96263a-e229-447e-aa6b-dd9c2872c751] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:08:57.209420 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-86a13b25-bb54-4162-9656-8af9f5e60a80 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:08:57.209879 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-86a13b25-bb54-4162-9656-8af9f5e60a80 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:08:57.210016 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-d4989707-bdee-48dc-a034-392dbb635cae tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] 10.222.0.20 "GET /compute/v2.1/servers/30391772-c0aa-468b-a414-c40c716a2481" status: 200 len: 1751 microversion: 2.1 time: 0.234423 Jul 01 04:08:57.211016 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 229/465] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:08:56 2022] GET /compute/v2.1/servers/30391772-c0aa-468b-a414-c40c716a2481 => generated 1751 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:08:57.211108 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-86a13b25-bb54-4162-9656-8af9f5e60a80 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:08:57.211191 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-86a13b25-bb54-4162-9656-8af9f5e60a80 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:08:57.465669 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-86a13b25-bb54-4162-9656-8af9f5e60a80 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] 10.222.0.20 "POST /compute/v2.1/servers/1f96263a-e229-447e-aa6b-dd9c2872c751/action" status: 202 len: 0 microversion: 2.1 time: 0.267583 Jul 01 04:08:57.467192 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 237/466] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Jul 1 04:08:57 2022] POST /compute/v2.1/servers/1f96263a-e229-447e-aa6b-dd9c2872c751/action => generated 0 bytes in 270 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 04:08:57.478554 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-fe9766d6-3b7c-4829-bd94-b9382f56c72d tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:08:57.480219 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-fe9766d6-3b7c-4829-bd94-b9382f56c72d tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] [instance: 1f96263a-e229-447e-aa6b-dd9c2872c751] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:08:57.491649 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-fe9766d6-3b7c-4829-bd94-b9382f56c72d tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:08:57.492958 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-fe9766d6-3b7c-4829-bd94-b9382f56c72d tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:08:57.495671 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-fe9766d6-3b7c-4829-bd94-b9382f56c72d tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:08:57.496533 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-fe9766d6-3b7c-4829-bd94-b9382f56c72d tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:08:57.657876 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-fe9766d6-3b7c-4829-bd94-b9382f56c72d tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8622ec5212c84d87b9b7c8f725012a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0143140d4f649478e36abcee284640c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:08:57.665986 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-fe9766d6-3b7c-4829-bd94-b9382f56c72d tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] 10.222.0.20 "GET /compute/v2.1/servers/1f96263a-e229-447e-aa6b-dd9c2872c751" status: 200 len: 1724 microversion: 2.1 time: 0.194300 Jul 01 04:08:57.666566 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 230/467] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:08:57 2022] GET /compute/v2.1/servers/1f96263a-e229-447e-aa6b-dd9c2872c751 => generated 1724 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:08:57.790941 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-bb2bc717-8e10-4c3d-ac67-1e9cd92c849b tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:08:57.792101 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-bb2bc717-8e10-4c3d-ac67-1e9cd92c849b tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] [instance: 246ef166-ec68-4657-b7b2-529c41cb4429] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:08:57.799347 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-bb2bc717-8e10-4c3d-ac67-1e9cd92c849b tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:08:57.799801 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-bb2bc717-8e10-4c3d-ac67-1e9cd92c849b tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:08:57.800562 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-bb2bc717-8e10-4c3d-ac67-1e9cd92c849b tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:08:57.800994 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-bb2bc717-8e10-4c3d-ac67-1e9cd92c849b tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:08:57.949573 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-bb2bc717-8e10-4c3d-ac67-1e9cd92c849b tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e9707561b4a4811bd7a7d3fed4fcd6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da99a87350634e9ea8a89f314f5e6118', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:08:57.960874 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-bb2bc717-8e10-4c3d-ac67-1e9cd92c849b tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] 10.222.0.20 "GET /compute/v2.1/servers/246ef166-ec68-4657-b7b2-529c41cb4429" status: 200 len: 1266 microversion: 2.1 time: 0.174076 Jul 01 04:08:57.961920 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 238/468] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:08:57 2022] GET /compute/v2.1/servers/246ef166-ec68-4657-b7b2-529c41cb4429 => generated 1266 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:08:58.227817 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-037ef425-df0f-4c1d-8290-bbfc01577b4c tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:08:58.228431 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-037ef425-df0f-4c1d-8290-bbfc01577b4c tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] [instance: 30391772-c0aa-468b-a414-c40c716a2481] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:08:58.234787 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-037ef425-df0f-4c1d-8290-bbfc01577b4c tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:08:58.242287 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-037ef425-df0f-4c1d-8290-bbfc01577b4c tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:08:58.242287 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-037ef425-df0f-4c1d-8290-bbfc01577b4c tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:08:58.242287 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-037ef425-df0f-4c1d-8290-bbfc01577b4c tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:08:58.393486 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-037ef425-df0f-4c1d-8290-bbfc01577b4c tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abc2e04754884398afc999d423e2a711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2940ca71c4b24b5facc194b61d748a11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:08:58.402759 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-037ef425-df0f-4c1d-8290-bbfc01577b4c tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] 10.222.0.20 "GET /compute/v2.1/servers/30391772-c0aa-468b-a414-c40c716a2481" status: 200 len: 1751 microversion: 2.1 time: 0.178937 Jul 01 04:08:58.403419 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 231/469] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:08:58 2022] GET /compute/v2.1/servers/30391772-c0aa-468b-a414-c40c716a2481 => generated 1751 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 04:08:58.685020 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-60cce8b6-81bc-4e93-a0a0-c18acfb97fe8 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:08:58.685799 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-60cce8b6-81bc-4e93-a0a0-c18acfb97fe8 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] [instance: 1f96263a-e229-447e-aa6b-dd9c2872c751] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:08:58.693012 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-60cce8b6-81bc-4e93-a0a0-c18acfb97fe8 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:08:58.693464 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-60cce8b6-81bc-4e93-a0a0-c18acfb97fe8 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:08:58.694375 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-60cce8b6-81bc-4e93-a0a0-c18acfb97fe8 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:08:58.694827 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-60cce8b6-81bc-4e93-a0a0-c18acfb97fe8 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:08:58.841127 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-60cce8b6-81bc-4e93-a0a0-c18acfb97fe8 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8622ec5212c84d87b9b7c8f725012a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0143140d4f649478e36abcee284640c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:08:58.849846 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-60cce8b6-81bc-4e93-a0a0-c18acfb97fe8 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] 10.222.0.20 "GET /compute/v2.1/servers/1f96263a-e229-447e-aa6b-dd9c2872c751" status: 200 len: 1724 microversion: 2.1 time: 0.169165 Jul 01 04:08:58.850440 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 239/470] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:08:58 2022] GET /compute/v2.1/servers/1f96263a-e229-447e-aa6b-dd9c2872c751 => generated 1724 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:08:58.979194 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-98bca65e-3d0a-4c8f-bf48-01fe74eba5d0 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:08:58.979820 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-98bca65e-3d0a-4c8f-bf48-01fe74eba5d0 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] [instance: 246ef166-ec68-4657-b7b2-529c41cb4429] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:08:58.989764 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-98bca65e-3d0a-4c8f-bf48-01fe74eba5d0 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:08:58.990353 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-98bca65e-3d0a-4c8f-bf48-01fe74eba5d0 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:08:58.991175 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-98bca65e-3d0a-4c8f-bf48-01fe74eba5d0 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:08:58.991866 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-98bca65e-3d0a-4c8f-bf48-01fe74eba5d0 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:08:59.274904 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-98bca65e-3d0a-4c8f-bf48-01fe74eba5d0 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e9707561b4a4811bd7a7d3fed4fcd6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da99a87350634e9ea8a89f314f5e6118', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:08:59.297057 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-98bca65e-3d0a-4c8f-bf48-01fe74eba5d0 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] 10.222.0.20 "GET /compute/v2.1/servers/246ef166-ec68-4657-b7b2-529c41cb4429" status: 200 len: 1266 microversion: 2.1 time: 0.321311 Jul 01 04:08:59.310351 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 232/471] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:08:58 2022] GET /compute/v2.1/servers/246ef166-ec68-4657-b7b2-529c41cb4429 => generated 1266 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:08:59.420655 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-361676b5-0bd0-4f2b-bee3-6a41345e5194 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:08:59.421572 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-361676b5-0bd0-4f2b-bee3-6a41345e5194 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] [instance: 30391772-c0aa-468b-a414-c40c716a2481] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:08:59.428828 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-361676b5-0bd0-4f2b-bee3-6a41345e5194 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:08:59.429663 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-361676b5-0bd0-4f2b-bee3-6a41345e5194 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:08:59.430914 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-361676b5-0bd0-4f2b-bee3-6a41345e5194 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:08:59.431706 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-361676b5-0bd0-4f2b-bee3-6a41345e5194 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:08:59.437858 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG dbcounter [-] [118712] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=118712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:08:59.664820 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-361676b5-0bd0-4f2b-bee3-6a41345e5194 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abc2e04754884398afc999d423e2a711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2940ca71c4b24b5facc194b61d748a11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:08:59.675477 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-361676b5-0bd0-4f2b-bee3-6a41345e5194 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] 10.222.0.20 "GET /compute/v2.1/servers/30391772-c0aa-468b-a414-c40c716a2481" status: 200 len: 1756 microversion: 2.1 time: 0.258989 Jul 01 04:08:59.676651 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 240/472] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:08:59 2022] GET /compute/v2.1/servers/30391772-c0aa-468b-a414-c40c716a2481 => generated 1756 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:08:59.761697 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-1e5243ec-1590-4cd3-94fb-7eeafb590d47 tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1407254687", "imageRef": "66f9f4ba-339c-4967-8857-d65299a66629", "flavorRef": "452", "networks": [{"uuid": "e654d240-5e2e-4d49-8404-34c396ff0d3d"}]}} {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 04:08:59.827368 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.network.neutron [None req-1e5243ec-1590-4cd3-94fb-7eeafb590d47 tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] validate_networks() for [('e654d240-5e2e-4d49-8404-34c396ff0d3d', None, None, None, None, None)] {{(pid=118711) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 01 04:08:59.868905 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-960e841d-3d2d-4b4a-87e1-a11449a523fb tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:08:59.870925 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-960e841d-3d2d-4b4a-87e1-a11449a523fb tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] [instance: 1f96263a-e229-447e-aa6b-dd9c2872c751] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:08:59.882073 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-960e841d-3d2d-4b4a-87e1-a11449a523fb tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:08:59.882537 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-960e841d-3d2d-4b4a-87e1-a11449a523fb tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:08:59.883438 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-960e841d-3d2d-4b4a-87e1-a11449a523fb tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:08:59.883885 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-960e841d-3d2d-4b4a-87e1-a11449a523fb tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:09:00.049996 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-960e841d-3d2d-4b4a-87e1-a11449a523fb tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8622ec5212c84d87b9b7c8f725012a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0143140d4f649478e36abcee284640c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:09:00.060253 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-960e841d-3d2d-4b4a-87e1-a11449a523fb tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] 10.222.0.20 "GET /compute/v2.1/servers/1f96263a-e229-447e-aa6b-dd9c2872c751" status: 200 len: 1724 microversion: 2.1 time: 0.195510 Jul 01 04:09:00.060848 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 241/473] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:08:59 2022] GET /compute/v2.1/servers/1f96263a-e229-447e-aa6b-dd9c2872c751 => generated 1724 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:09:00.289634 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.virt.hardware [None req-1e5243ec-1590-4cd3-94fb-7eeafb590d47 tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Flavor limits 0:0:0 {{(pid=118711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 01 04:09:00.290116 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.virt.hardware [None req-1e5243ec-1590-4cd3-94fb-7eeafb590d47 tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Image limits 0:0:0 {{(pid=118711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 01 04:09:00.290552 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.virt.hardware [None req-1e5243ec-1590-4cd3-94fb-7eeafb590d47 tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Flavor pref 0:0:0 {{(pid=118711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 01 04:09:00.291037 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.virt.hardware [None req-1e5243ec-1590-4cd3-94fb-7eeafb590d47 tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Image pref 0:0:0 {{(pid=118711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 01 04:09:00.291505 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.virt.hardware [None req-1e5243ec-1590-4cd3-94fb-7eeafb590d47 tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 01 04:09:00.301788 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-1e5243ec-1590-4cd3-94fb-7eeafb590d47 tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:09:00.302191 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-1e5243ec-1590-4cd3-94fb-7eeafb590d47 tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:09:00.302998 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-1e5243ec-1590-4cd3-94fb-7eeafb590d47 tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:09:00.303483 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-1e5243ec-1590-4cd3-94fb-7eeafb590d47 tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:09:00.321895 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.quota [None req-1e5243ec-1590-4cd3-94fb-7eeafb590d47 tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Getting quotas for project e87ca5d9f50847d6ab501ca3a51ab37c. Resources: {'ram', 'cores', 'instances'} {{(pid=118711) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 04:09:00.323523 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-d5ab9e8a-71aa-43e9-8c8c-d1028509f2b2 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:09:00.324227 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-d5ab9e8a-71aa-43e9-8c8c-d1028509f2b2 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] [instance: 246ef166-ec68-4657-b7b2-529c41cb4429] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:09:00.326255 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.quota [None req-1e5243ec-1590-4cd3-94fb-7eeafb590d47 tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Getting quotas for user 021817b0eef94fc2a19d90c511ec9298 and project e87ca5d9f50847d6ab501ca3a51ab37c. Resources: {'ram', 'cores', 'instances'} {{(pid=118711) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 04:09:00.331899 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-d5ab9e8a-71aa-43e9-8c8c-d1028509f2b2 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:09:00.332490 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-d5ab9e8a-71aa-43e9-8c8c-d1028509f2b2 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:09:00.333378 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-d5ab9e8a-71aa-43e9-8c8c-d1028509f2b2 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:09:00.333823 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-d5ab9e8a-71aa-43e9-8c8c-d1028509f2b2 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:09:00.338958 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-1e5243ec-1590-4cd3-94fb-7eeafb590d47 tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Going to run 1 instances... {{(pid=118711) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 01 04:09:00.341438 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-1e5243ec-1590-4cd3-94fb-7eeafb590d47 tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] [instance: fa6a7a92-a9c5-41a4-b8d4-356787a243bc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='66f9f4ba-339c-4967-8857-d65299a66629',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118711) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 01 04:09:00.472611 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-1e5243ec-1590-4cd3-94fb-7eeafb590d47 tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.716161 Jul 01 04:09:00.473417 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 233/474] 10.222.0.20 () {60 vars in 1146 bytes} [Fri Jul 1 04:08:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 718 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 01 04:09:00.478776 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-d5ab9e8a-71aa-43e9-8c8c-d1028509f2b2 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e9707561b4a4811bd7a7d3fed4fcd6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da99a87350634e9ea8a89f314f5e6118', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:09:00.485099 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-174c7e64-3161-4708-aceb-eeb5830cbb8d tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:09:00.485713 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-174c7e64-3161-4708-aceb-eeb5830cbb8d tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] [instance: fa6a7a92-a9c5-41a4-b8d4-356787a243bc] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:09:00.492383 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-d5ab9e8a-71aa-43e9-8c8c-d1028509f2b2 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] 10.222.0.20 "GET /compute/v2.1/servers/246ef166-ec68-4657-b7b2-529c41cb4429" status: 200 len: 1266 microversion: 2.1 time: 0.169520 Jul 01 04:09:00.493057 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 242/475] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:09:00 2022] GET /compute/v2.1/servers/246ef166-ec68-4657-b7b2-529c41cb4429 => generated 1266 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 04:09:00.539848 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-174c7e64-3161-4708-aceb-eeb5830cbb8d tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021817b0eef94fc2a19d90c511ec9298', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87ca5d9f50847d6ab501ca3a51ab37c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:09:00.551311 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-174c7e64-3161-4708-aceb-eeb5830cbb8d tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] 10.222.0.20 "GET /compute/v2.1/servers/fa6a7a92-a9c5-41a4-b8d4-356787a243bc" status: 200 len: 1219 microversion: 2.1 time: 0.070732 Jul 01 04:09:00.551974 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 234/476] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:09:00 2022] GET /compute/v2.1/servers/fa6a7a92-a9c5-41a4-b8d4-356787a243bc => generated 1219 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 04:09:00.694776 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-4464876c-853c-41fe-8e5e-ccd07b56fe26 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:09:00.695502 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-4464876c-853c-41fe-8e5e-ccd07b56fe26 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] [instance: 30391772-c0aa-468b-a414-c40c716a2481] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:09:00.703380 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-4464876c-853c-41fe-8e5e-ccd07b56fe26 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:09:00.703848 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-4464876c-853c-41fe-8e5e-ccd07b56fe26 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:09:00.704643 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-4464876c-853c-41fe-8e5e-ccd07b56fe26 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:09:00.705095 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-4464876c-853c-41fe-8e5e-ccd07b56fe26 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:09:00.866946 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-4464876c-853c-41fe-8e5e-ccd07b56fe26 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abc2e04754884398afc999d423e2a711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2940ca71c4b24b5facc194b61d748a11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:09:00.883480 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-4464876c-853c-41fe-8e5e-ccd07b56fe26 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] 10.222.0.20 "GET /compute/v2.1/servers/30391772-c0aa-468b-a414-c40c716a2481" status: 200 len: 1756 microversion: 2.1 time: 0.191746 Jul 01 04:09:00.886568 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 243/477] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:09:00 2022] GET /compute/v2.1/servers/30391772-c0aa-468b-a414-c40c716a2481 => generated 1756 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 04:09:00.908589 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [req-cb2d0ef7-042f-41e3-b26f-5ab4b077906f req-f05f789c-9eec-4966-833f-7200c974ff61 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "246ef166-ec68-4657-b7b2-529c41cb4429", "name": "network-vif-plugged", "status": "completed", "tag": "706047c1-eb46-4189-838b-5b3bd921b5c5"}]} {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 04:09:00.919728 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [req-cb2d0ef7-042f-41e3-b26f-5ab4b077906f req-f05f789c-9eec-4966-833f-7200c974ff61 service nova] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:09:00.920182 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [req-cb2d0ef7-042f-41e3-b26f-5ab4b077906f req-f05f789c-9eec-4966-833f-7200c974ff61 service nova] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:09:00.930869 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.compute.server_external_events [req-cb2d0ef7-042f-41e3-b26f-5ab4b077906f req-f05f789c-9eec-4966-833f-7200c974ff61 service nova] Creating event network-vif-plugged:706047c1-eb46-4189-838b-5b3bd921b5c5 for instance 246ef166-ec68-4657-b7b2-529c41cb4429 on hv-cinder-84684 Jul 01 04:09:00.936420 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [req-cb2d0ef7-042f-41e3-b26f-5ab4b077906f req-f05f789c-9eec-4966-833f-7200c974ff61 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035688 Jul 01 04:09:00.936540 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 235/478] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Jul 1 04:09:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 04:09:01.085536 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-c80c3b30-6c0a-4c0c-90aa-b7fe12cd7d4c tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:09:01.086701 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-c80c3b30-6c0a-4c0c-90aa-b7fe12cd7d4c tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] [instance: 1f96263a-e229-447e-aa6b-dd9c2872c751] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:09:01.089130 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG dbcounter [-] [118712] Writing DB stats nova_api:SELECT=78,nova_api:UPDATE=1 {{(pid=118712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:09:01.094363 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-c80c3b30-6c0a-4c0c-90aa-b7fe12cd7d4c tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:09:01.094818 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-c80c3b30-6c0a-4c0c-90aa-b7fe12cd7d4c tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:09:01.095635 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-c80c3b30-6c0a-4c0c-90aa-b7fe12cd7d4c tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:09:01.096072 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-c80c3b30-6c0a-4c0c-90aa-b7fe12cd7d4c tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:09:01.242311 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-c80c3b30-6c0a-4c0c-90aa-b7fe12cd7d4c tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8622ec5212c84d87b9b7c8f725012a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0143140d4f649478e36abcee284640c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:09:01.251031 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-c80c3b30-6c0a-4c0c-90aa-b7fe12cd7d4c tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] 10.222.0.20 "GET /compute/v2.1/servers/1f96263a-e229-447e-aa6b-dd9c2872c751" status: 200 len: 1724 microversion: 2.1 time: 0.173001 Jul 01 04:09:01.251644 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 244/479] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:09:01 2022] GET /compute/v2.1/servers/1f96263a-e229-447e-aa6b-dd9c2872c751 => generated 1724 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:09:01.511123 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-ce8b16fc-dae0-4007-9cd4-781c3c0ed3c9 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:09:01.511919 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-ce8b16fc-dae0-4007-9cd4-781c3c0ed3c9 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] [instance: 246ef166-ec68-4657-b7b2-529c41cb4429] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:09:01.513903 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG dbcounter [-] [118711] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6 {{(pid=118711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:09:01.520819 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-ce8b16fc-dae0-4007-9cd4-781c3c0ed3c9 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:09:01.521877 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-ce8b16fc-dae0-4007-9cd4-781c3c0ed3c9 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:09:01.523430 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-ce8b16fc-dae0-4007-9cd4-781c3c0ed3c9 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:09:01.524398 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-ce8b16fc-dae0-4007-9cd4-781c3c0ed3c9 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:09:01.570455 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-42162aa8-9377-4639-bcaa-37bdc881c7b3 tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:09:01.571073 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-42162aa8-9377-4639-bcaa-37bdc881c7b3 tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] [instance: fa6a7a92-a9c5-41a4-b8d4-356787a243bc] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:09:01.636748 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-42162aa8-9377-4639-bcaa-37bdc881c7b3 tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021817b0eef94fc2a19d90c511ec9298', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87ca5d9f50847d6ab501ca3a51ab37c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:09:01.645728 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-42162aa8-9377-4639-bcaa-37bdc881c7b3 tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] 10.222.0.20 "GET /compute/v2.1/servers/fa6a7a92-a9c5-41a4-b8d4-356787a243bc" status: 200 len: 1219 microversion: 2.1 time: 0.079939 Jul 01 04:09:01.646237 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 245/480] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:09:01 2022] GET /compute/v2.1/servers/fa6a7a92-a9c5-41a4-b8d4-356787a243bc => generated 1219 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 04:09:01.679188 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-ce8b16fc-dae0-4007-9cd4-781c3c0ed3c9 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e9707561b4a4811bd7a7d3fed4fcd6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da99a87350634e9ea8a89f314f5e6118', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:09:01.686619 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-ce8b16fc-dae0-4007-9cd4-781c3c0ed3c9 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] 10.222.0.20 "GET /compute/v2.1/servers/246ef166-ec68-4657-b7b2-529c41cb4429" status: 200 len: 1266 microversion: 2.1 time: 0.180892 Jul 01 04:09:01.687178 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 236/481] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:09:01 2022] GET /compute/v2.1/servers/246ef166-ec68-4657-b7b2-529c41cb4429 => generated 1266 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:09:01.922081 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-854091af-1707-48c0-941a-166b502a1bb4 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:09:01.922897 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-854091af-1707-48c0-941a-166b502a1bb4 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] [instance: 30391772-c0aa-468b-a414-c40c716a2481] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:09:01.929464 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-854091af-1707-48c0-941a-166b502a1bb4 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:09:01.933965 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-854091af-1707-48c0-941a-166b502a1bb4 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:09:01.933965 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-854091af-1707-48c0-941a-166b502a1bb4 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:09:01.933965 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-854091af-1707-48c0-941a-166b502a1bb4 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:09:02.090426 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-854091af-1707-48c0-941a-166b502a1bb4 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abc2e04754884398afc999d423e2a711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2940ca71c4b24b5facc194b61d748a11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:09:02.099117 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-854091af-1707-48c0-941a-166b502a1bb4 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] 10.222.0.20 "GET /compute/v2.1/servers/30391772-c0aa-468b-a414-c40c716a2481" status: 200 len: 1756 microversion: 2.1 time: 0.181158 Jul 01 04:09:02.099735 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 246/482] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:09:01 2022] GET /compute/v2.1/servers/30391772-c0aa-468b-a414-c40c716a2481 => generated 1756 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:09:02.269494 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-bcc77527-9a81-4f64-a953-7fe86b4d1e92 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:09:02.270117 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-bcc77527-9a81-4f64-a953-7fe86b4d1e92 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] [instance: 1f96263a-e229-447e-aa6b-dd9c2872c751] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:09:02.277058 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-bcc77527-9a81-4f64-a953-7fe86b4d1e92 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:09:02.277513 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-bcc77527-9a81-4f64-a953-7fe86b4d1e92 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:09:02.278302 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-bcc77527-9a81-4f64-a953-7fe86b4d1e92 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:09:02.278740 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-bcc77527-9a81-4f64-a953-7fe86b4d1e92 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:09:02.503161 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-bcc77527-9a81-4f64-a953-7fe86b4d1e92 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8622ec5212c84d87b9b7c8f725012a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0143140d4f649478e36abcee284640c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:09:02.512351 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-bcc77527-9a81-4f64-a953-7fe86b4d1e92 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] 10.222.0.20 "GET /compute/v2.1/servers/1f96263a-e229-447e-aa6b-dd9c2872c751" status: 200 len: 1730 microversion: 2.1 time: 0.247124 Jul 01 04:09:02.512967 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 237/483] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:09:02 2022] GET /compute/v2.1/servers/1f96263a-e229-447e-aa6b-dd9c2872c751 => generated 1730 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 04:09:02.530655 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-b52f676d-7944-49d5-b7ae-6f9bae7e6567 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:09:02.531069 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-b52f676d-7944-49d5-b7ae-6f9bae7e6567 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] [instance: 1f96263a-e229-447e-aa6b-dd9c2872c751] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:09:02.537468 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-b52f676d-7944-49d5-b7ae-6f9bae7e6567 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:09:02.537922 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-b52f676d-7944-49d5-b7ae-6f9bae7e6567 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:09:02.538701 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-b52f676d-7944-49d5-b7ae-6f9bae7e6567 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:09:02.539147 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-b52f676d-7944-49d5-b7ae-6f9bae7e6567 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:09:02.623294 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-b52f676d-7944-49d5-b7ae-6f9bae7e6567 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] 10.222.0.20 "GET /compute/v2.1/servers/1f96263a-e229-447e-aa6b-dd9c2872c751/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.097118 Jul 01 04:09:02.623904 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 247/484] 10.222.0.20 () {58 vars in 1274 bytes} [Fri Jul 1 04:09:02 2022] GET /compute/v2.1/servers/1f96263a-e229-447e-aa6b-dd9c2872c751/os-interface => generated 284 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 04:09:02.663658 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-8003643a-7146-497f-8713-7a31b2e33bee tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:09:02.664258 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-8003643a-7146-497f-8713-7a31b2e33bee tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] [instance: fa6a7a92-a9c5-41a4-b8d4-356787a243bc] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:09:02.671175 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-8003643a-7146-497f-8713-7a31b2e33bee tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:09:02.671895 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-8003643a-7146-497f-8713-7a31b2e33bee tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:09:02.675859 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-8003643a-7146-497f-8713-7a31b2e33bee tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:09:02.675859 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-8003643a-7146-497f-8713-7a31b2e33bee tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:09:02.708413 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-12a943ee-ca4c-4394-b987-acbe30bb25cc tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:09:02.709591 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-12a943ee-ca4c-4394-b987-acbe30bb25cc tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] [instance: 246ef166-ec68-4657-b7b2-529c41cb4429] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:09:02.720623 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-12a943ee-ca4c-4394-b987-acbe30bb25cc tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:09:02.721739 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-12a943ee-ca4c-4394-b987-acbe30bb25cc tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:09:02.723187 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-12a943ee-ca4c-4394-b987-acbe30bb25cc tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:09:02.724094 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-12a943ee-ca4c-4394-b987-acbe30bb25cc tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:09:02.780128 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-8003643a-7146-497f-8713-7a31b2e33bee tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021817b0eef94fc2a19d90c511ec9298', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87ca5d9f50847d6ab501ca3a51ab37c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:09:02.793306 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-8003643a-7146-497f-8713-7a31b2e33bee tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] 10.222.0.20 "GET /compute/v2.1/servers/fa6a7a92-a9c5-41a4-b8d4-356787a243bc" status: 200 len: 1215 microversion: 2.1 time: 0.133413 Jul 01 04:09:02.793907 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 238/485] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:09:02 2022] GET /compute/v2.1/servers/fa6a7a92-a9c5-41a4-b8d4-356787a243bc => generated 1215 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:09:02.918563 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-12a943ee-ca4c-4394-b987-acbe30bb25cc tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e9707561b4a4811bd7a7d3fed4fcd6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da99a87350634e9ea8a89f314f5e6118', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:09:02.929891 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-12a943ee-ca4c-4394-b987-acbe30bb25cc tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] 10.222.0.20 "GET /compute/v2.1/servers/246ef166-ec68-4657-b7b2-529c41cb4429" status: 200 len: 1266 microversion: 2.1 time: 0.228978 Jul 01 04:09:02.930927 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 248/486] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:09:02 2022] GET /compute/v2.1/servers/246ef166-ec68-4657-b7b2-529c41cb4429 => generated 1266 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 04:09:03.136307 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-bf39fc62-8e73-4c1e-a963-87d023212491 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:09:03.136307 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-bf39fc62-8e73-4c1e-a963-87d023212491 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] [instance: 30391772-c0aa-468b-a414-c40c716a2481] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:09:03.136307 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-bf39fc62-8e73-4c1e-a963-87d023212491 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:09:03.136307 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-bf39fc62-8e73-4c1e-a963-87d023212491 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:09:03.136796 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-bf39fc62-8e73-4c1e-a963-87d023212491 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:09:03.136886 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-bf39fc62-8e73-4c1e-a963-87d023212491 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:09:03.367184 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-bf39fc62-8e73-4c1e-a963-87d023212491 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abc2e04754884398afc999d423e2a711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2940ca71c4b24b5facc194b61d748a11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:09:03.378451 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-bf39fc62-8e73-4c1e-a963-87d023212491 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] 10.222.0.20 "GET /compute/v2.1/servers/30391772-c0aa-468b-a414-c40c716a2481" status: 200 len: 1756 microversion: 2.1 time: 0.255242 Jul 01 04:09:03.378451 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 239/487] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:09:03 2022] GET /compute/v2.1/servers/30391772-c0aa-468b-a414-c40c716a2481 => generated 1756 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:09:03.766314 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [req-b5c15abe-1031-420b-85e8-2b183f8299ed req-b10640af-3e33-4a49-8248-a78289d5cc05 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1f96263a-e229-447e-aa6b-dd9c2872c751", "tag": "562a39f3-c337-47af-9f9d-fabcdc36a52b"}]} {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 04:09:03.787338 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [req-b5c15abe-1031-420b-85e8-2b183f8299ed req-b10640af-3e33-4a49-8248-a78289d5cc05 service nova] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:09:03.792954 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [req-b5c15abe-1031-420b-85e8-2b183f8299ed req-b10640af-3e33-4a49-8248-a78289d5cc05 service nova] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:09:03.815102 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-dd7cae2d-446e-4c70-ad19-c19b97dc9617 tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:09:03.815938 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-dd7cae2d-446e-4c70-ad19-c19b97dc9617 tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] [instance: fa6a7a92-a9c5-41a4-b8d4-356787a243bc] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:09:03.817664 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.compute.server_external_events [req-b5c15abe-1031-420b-85e8-2b183f8299ed req-b10640af-3e33-4a49-8248-a78289d5cc05 service nova] Creating event network-changed:562a39f3-c337-47af-9f9d-fabcdc36a52b for instance 1f96263a-e229-447e-aa6b-dd9c2872c751 on hv-cinder-84684 Jul 01 04:09:03.824772 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [req-b5c15abe-1031-420b-85e8-2b183f8299ed req-b10640af-3e33-4a49-8248-a78289d5cc05 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064617 Jul 01 04:09:03.827043 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 249/488] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Jul 1 04:09:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 04:09:03.827980 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-dd7cae2d-446e-4c70-ad19-c19b97dc9617 tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:09:03.828814 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-dd7cae2d-446e-4c70-ad19-c19b97dc9617 tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:09:03.830122 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-dd7cae2d-446e-4c70-ad19-c19b97dc9617 tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:09:03.830564 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-dd7cae2d-446e-4c70-ad19-c19b97dc9617 tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:09:03.851944 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG dbcounter [-] [118711] Writing DB stats nova_cell1:SELECT=100 {{(pid=118711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:09:03.904592 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-dd7cae2d-446e-4c70-ad19-c19b97dc9617 tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021817b0eef94fc2a19d90c511ec9298', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87ca5d9f50847d6ab501ca3a51ab37c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:09:03.912931 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-dd7cae2d-446e-4c70-ad19-c19b97dc9617 tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] 10.222.0.20 "GET /compute/v2.1/servers/fa6a7a92-a9c5-41a4-b8d4-356787a243bc" status: 200 len: 1271 microversion: 2.1 time: 0.101887 Jul 01 04:09:03.913927 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 240/489] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:09:03 2022] GET /compute/v2.1/servers/fa6a7a92-a9c5-41a4-b8d4-356787a243bc => generated 1271 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 04:09:03.947505 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-55d4410b-6f04-4e2b-9dff-fbbe7a7312a5 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:09:03.948292 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-55d4410b-6f04-4e2b-9dff-fbbe7a7312a5 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] [instance: 246ef166-ec68-4657-b7b2-529c41cb4429] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:09:03.955031 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-55d4410b-6f04-4e2b-9dff-fbbe7a7312a5 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:09:03.955543 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-55d4410b-6f04-4e2b-9dff-fbbe7a7312a5 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:09:03.956356 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-55d4410b-6f04-4e2b-9dff-fbbe7a7312a5 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:09:03.956827 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-55d4410b-6f04-4e2b-9dff-fbbe7a7312a5 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:09:04.118784 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-55d4410b-6f04-4e2b-9dff-fbbe7a7312a5 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e9707561b4a4811bd7a7d3fed4fcd6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da99a87350634e9ea8a89f314f5e6118', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:09:04.128959 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-55d4410b-6f04-4e2b-9dff-fbbe7a7312a5 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] 10.222.0.20 "GET /compute/v2.1/servers/246ef166-ec68-4657-b7b2-529c41cb4429" status: 200 len: 1266 microversion: 2.1 time: 0.185591 Jul 01 04:09:04.129611 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 250/490] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:09:03 2022] GET /compute/v2.1/servers/246ef166-ec68-4657-b7b2-529c41cb4429 => generated 1266 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:09:04.399135 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-b03d795b-8769-4a0c-9bfa-becea6ad984d tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:09:04.400300 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-b03d795b-8769-4a0c-9bfa-becea6ad984d tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] [instance: 30391772-c0aa-468b-a414-c40c716a2481] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:09:04.432773 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-b03d795b-8769-4a0c-9bfa-becea6ad984d tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:09:04.434014 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-b03d795b-8769-4a0c-9bfa-becea6ad984d tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:09:04.435915 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-b03d795b-8769-4a0c-9bfa-becea6ad984d tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:09:04.436752 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-b03d795b-8769-4a0c-9bfa-becea6ad984d tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:09:04.936911 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-8f5e5372-8e7c-44b7-b8c4-98c6bf8c0af5 tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:09:04.936911 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-8f5e5372-8e7c-44b7-b8c4-98c6bf8c0af5 tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] [instance: fa6a7a92-a9c5-41a4-b8d4-356787a243bc] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:09:04.942076 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-8f5e5372-8e7c-44b7-b8c4-98c6bf8c0af5 tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:09:04.942502 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-8f5e5372-8e7c-44b7-b8c4-98c6bf8c0af5 tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:09:04.943307 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-8f5e5372-8e7c-44b7-b8c4-98c6bf8c0af5 tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:09:04.943761 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-8f5e5372-8e7c-44b7-b8c4-98c6bf8c0af5 tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:09:05.008715 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-8f5e5372-8e7c-44b7-b8c4-98c6bf8c0af5 tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021817b0eef94fc2a19d90c511ec9298', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87ca5d9f50847d6ab501ca3a51ab37c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:09:05.017268 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-8f5e5372-8e7c-44b7-b8c4-98c6bf8c0af5 tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] 10.222.0.20 "GET /compute/v2.1/servers/fa6a7a92-a9c5-41a4-b8d4-356787a243bc" status: 200 len: 1277 microversion: 2.1 time: 0.090091 Jul 01 04:09:05.017849 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 251/491] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:09:04 2022] GET /compute/v2.1/servers/fa6a7a92-a9c5-41a4-b8d4-356787a243bc => generated 1277 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 04:09:05.098806 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-b03d795b-8769-4a0c-9bfa-becea6ad984d tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abc2e04754884398afc999d423e2a711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2940ca71c4b24b5facc194b61d748a11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:09:05.106972 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-b03d795b-8769-4a0c-9bfa-becea6ad984d tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] 10.222.0.20 "GET /compute/v2.1/servers/30391772-c0aa-468b-a414-c40c716a2481" status: 200 len: 1756 microversion: 2.1 time: 0.715268 Jul 01 04:09:05.107584 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 241/492] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:09:04 2022] GET /compute/v2.1/servers/30391772-c0aa-468b-a414-c40c716a2481 => generated 1756 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:09:05.146722 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-d7938bbd-4168-44a0-8316-5d46c4774f26 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:09:05.147385 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-d7938bbd-4168-44a0-8316-5d46c4774f26 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] [instance: 246ef166-ec68-4657-b7b2-529c41cb4429] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:09:05.153908 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-d7938bbd-4168-44a0-8316-5d46c4774f26 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:09:05.154410 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-d7938bbd-4168-44a0-8316-5d46c4774f26 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:09:05.156428 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-d7938bbd-4168-44a0-8316-5d46c4774f26 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:09:05.156883 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-d7938bbd-4168-44a0-8316-5d46c4774f26 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:09:05.553709 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-d7938bbd-4168-44a0-8316-5d46c4774f26 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e9707561b4a4811bd7a7d3fed4fcd6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da99a87350634e9ea8a89f314f5e6118', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:09:05.561651 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-d7938bbd-4168-44a0-8316-5d46c4774f26 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] 10.222.0.20 "GET /compute/v2.1/servers/246ef166-ec68-4657-b7b2-529c41cb4429" status: 200 len: 1453 microversion: 2.1 time: 0.418827 Jul 01 04:09:05.562601 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 252/493] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:09:05 2022] GET /compute/v2.1/servers/246ef166-ec68-4657-b7b2-529c41cb4429 => generated 1453 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:09:05.579069 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-e28022b8-ce3b-4072-92d5-fde8b044b248 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:09:05.580014 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-e28022b8-ce3b-4072-92d5-fde8b044b248 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] [instance: 246ef166-ec68-4657-b7b2-529c41cb4429] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:09:05.586236 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-e28022b8-ce3b-4072-92d5-fde8b044b248 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:09:05.586682 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-e28022b8-ce3b-4072-92d5-fde8b044b248 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:09:05.588080 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-e28022b8-ce3b-4072-92d5-fde8b044b248 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:09:05.588749 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-e28022b8-ce3b-4072-92d5-fde8b044b248 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:09:05.767826 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-e28022b8-ce3b-4072-92d5-fde8b044b248 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e9707561b4a4811bd7a7d3fed4fcd6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da99a87350634e9ea8a89f314f5e6118', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:09:05.780863 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-e28022b8-ce3b-4072-92d5-fde8b044b248 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] 10.222.0.20 "GET /compute/v2.1/servers/246ef166-ec68-4657-b7b2-529c41cb4429" status: 200 len: 1453 microversion: 2.1 time: 0.205284 Jul 01 04:09:05.781538 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 242/494] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:09:05 2022] GET /compute/v2.1/servers/246ef166-ec68-4657-b7b2-529c41cb4429 => generated 1453 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:09:05.843378 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [req-5e9672ac-6fce-46cf-b4ae-1e3256d9f72b req-33c48bae-46da-4738-95bd-4dc91777d845 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1f96263a-e229-447e-aa6b-dd9c2872c751", "tag": "562a39f3-c337-47af-9f9d-fabcdc36a52b"}]} {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 04:09:05.853954 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [req-5e9672ac-6fce-46cf-b4ae-1e3256d9f72b req-33c48bae-46da-4738-95bd-4dc91777d845 service nova] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:09:05.854513 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [req-5e9672ac-6fce-46cf-b4ae-1e3256d9f72b req-33c48bae-46da-4738-95bd-4dc91777d845 service nova] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:09:05.870197 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.compute.server_external_events [req-5e9672ac-6fce-46cf-b4ae-1e3256d9f72b req-33c48bae-46da-4738-95bd-4dc91777d845 service nova] Creating event network-changed:562a39f3-c337-47af-9f9d-fabcdc36a52b for instance 1f96263a-e229-447e-aa6b-dd9c2872c751 on hv-cinder-84684 Jul 01 04:09:05.876815 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [req-5e9672ac-6fce-46cf-b4ae-1e3256d9f72b req-33c48bae-46da-4738-95bd-4dc91777d845 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038142 Jul 01 04:09:05.878001 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 253/495] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Jul 1 04:09:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 01 04:09:06.038423 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-5a6ee823-ba71-48fc-963a-27b6104eadce tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:09:06.039638 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-5a6ee823-ba71-48fc-963a-27b6104eadce tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] [instance: fa6a7a92-a9c5-41a4-b8d4-356787a243bc] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:09:06.064955 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-5a6ee823-ba71-48fc-963a-27b6104eadce tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:09:06.065416 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-5a6ee823-ba71-48fc-963a-27b6104eadce tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:09:06.066226 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-5a6ee823-ba71-48fc-963a-27b6104eadce tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:09:06.068480 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-5a6ee823-ba71-48fc-963a-27b6104eadce tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:09:06.129338 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-f7288950-8500-415b-a1ba-7090854898d1 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:09:06.130156 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-f7288950-8500-415b-a1ba-7090854898d1 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] [instance: 30391772-c0aa-468b-a414-c40c716a2481] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:09:06.137850 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-f7288950-8500-415b-a1ba-7090854898d1 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:09:06.138315 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-f7288950-8500-415b-a1ba-7090854898d1 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:09:06.139108 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-f7288950-8500-415b-a1ba-7090854898d1 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:09:06.139763 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-f7288950-8500-415b-a1ba-7090854898d1 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:09:06.373145 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-f7288950-8500-415b-a1ba-7090854898d1 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abc2e04754884398afc999d423e2a711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2940ca71c4b24b5facc194b61d748a11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:09:06.384449 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-f7288950-8500-415b-a1ba-7090854898d1 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] 10.222.0.20 "GET /compute/v2.1/servers/30391772-c0aa-468b-a414-c40c716a2481" status: 200 len: 1756 microversion: 2.1 time: 0.260944 Jul 01 04:09:06.385327 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 254/496] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:09:06 2022] GET /compute/v2.1/servers/30391772-c0aa-468b-a414-c40c716a2481 => generated 1756 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:09:06.423708 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-5a6ee823-ba71-48fc-963a-27b6104eadce tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021817b0eef94fc2a19d90c511ec9298', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87ca5d9f50847d6ab501ca3a51ab37c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:09:06.432374 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-5a6ee823-ba71-48fc-963a-27b6104eadce tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] 10.222.0.20 "GET /compute/v2.1/servers/fa6a7a92-a9c5-41a4-b8d4-356787a243bc" status: 200 len: 1319 microversion: 2.1 time: 0.401708 Jul 01 04:09:06.433218 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 243/497] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:09:06 2022] GET /compute/v2.1/servers/fa6a7a92-a9c5-41a4-b8d4-356787a243bc => generated 1319 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:09:06.559057 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-186c56ca-3022-4858-9342-25830caa51aa tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:09:06.559579 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-186c56ca-3022-4858-9342-25830caa51aa tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] [instance: b904f233-887c-4c96-a2d2-f7f415ad852f] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:09:06.570476 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-186c56ca-3022-4858-9342-25830caa51aa tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:09:06.571686 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-186c56ca-3022-4858-9342-25830caa51aa tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:09:06.574215 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-186c56ca-3022-4858-9342-25830caa51aa tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:09:06.575658 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-186c56ca-3022-4858-9342-25830caa51aa tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:09:06.632641 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-186c56ca-3022-4858-9342-25830caa51aa tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] 10.222.0.20 "GET /compute/v2.1/servers/b904f233-887c-4c96-a2d2-f7f415ad852f/os-volume_attachments/7c547c39-6b7b-4767-b335-286035bb76a5" status: 200 len: 194 microversion: 2.20 time: 0.077663 Jul 01 04:09:06.639633 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 255/498] 10.222.0.20 () {60 vars in 1453 bytes} [Fri Jul 1 04:09:06 2022] GET /compute/v2.1/servers/b904f233-887c-4c96-a2d2-f7f415ad852f/os-volume_attachments/7c547c39-6b7b-4767-b335-286035bb76a5 => generated 194 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 01 04:09:06.725128 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-64781353-8bb7-477f-9bb3-44fd183301e7 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:09:06.725538 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-64781353-8bb7-477f-9bb3-44fd183301e7 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] [instance: b904f233-887c-4c96-a2d2-f7f415ad852f] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:09:06.732846 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-64781353-8bb7-477f-9bb3-44fd183301e7 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:09:06.733386 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-64781353-8bb7-477f-9bb3-44fd183301e7 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:09:06.734498 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-64781353-8bb7-477f-9bb3-44fd183301e7 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:09:06.735000 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-64781353-8bb7-477f-9bb3-44fd183301e7 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:09:06.824218 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.objects.instance [None req-64781353-8bb7-477f-9bb3-44fd183301e7 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lazy-loading 'services' on Instance uuid b904f233-887c-4c96-a2d2-f7f415ad852f {{(pid=118711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 04:09:07.085281 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-64781353-8bb7-477f-9bb3-44fd183301e7 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] 10.222.0.20 "DELETE /compute/v2.1/servers/b904f233-887c-4c96-a2d2-f7f415ad852f/os-volume_attachments/7c547c39-6b7b-4767-b335-286035bb76a5" status: 202 len: 0 microversion: 2.20 time: 0.365010 Jul 01 04:09:07.086643 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 244/499] 10.222.0.20 () {60 vars in 1456 bytes} [Fri Jul 1 04:09:06 2022] DELETE /compute/v2.1/servers/b904f233-887c-4c96-a2d2-f7f415ad852f/os-volume_attachments/7c547c39-6b7b-4767-b335-286035bb76a5 => generated 0 bytes in 370 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 01 04:09:07.098245 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-b871652e-8854-43bc-a1a2-0800225f1c4d tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:09:07.099304 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-b871652e-8854-43bc-a1a2-0800225f1c4d tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] [instance: b904f233-887c-4c96-a2d2-f7f415ad852f] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:09:07.107706 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-b871652e-8854-43bc-a1a2-0800225f1c4d tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:09:07.108156 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-b871652e-8854-43bc-a1a2-0800225f1c4d tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:09:07.109433 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-b871652e-8854-43bc-a1a2-0800225f1c4d tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:09:07.110825 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-b871652e-8854-43bc-a1a2-0800225f1c4d tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:09:07.147363 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-b871652e-8854-43bc-a1a2-0800225f1c4d tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] 10.222.0.20 "GET /compute/v2.1/servers/b904f233-887c-4c96-a2d2-f7f415ad852f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.055199 Jul 01 04:09:07.151827 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 256/500] 10.222.0.20 () {60 vars in 1342 bytes} [Fri Jul 1 04:09:07 2022] GET /compute/v2.1/servers/b904f233-887c-4c96-a2d2-f7f415ad852f/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 01 04:09:07.402774 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-6783d4a7-4268-4917-bc6e-e887bc742803 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:09:07.403566 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-6783d4a7-4268-4917-bc6e-e887bc742803 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] [instance: 30391772-c0aa-468b-a414-c40c716a2481] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:09:07.411798 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-6783d4a7-4268-4917-bc6e-e887bc742803 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:09:07.412259 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-6783d4a7-4268-4917-bc6e-e887bc742803 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:09:07.413019 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-6783d4a7-4268-4917-bc6e-e887bc742803 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:09:07.414133 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-6783d4a7-4268-4917-bc6e-e887bc742803 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:09:07.450008 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-3ad472f1-6347-45a8-bfcd-f1d665d893ec tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:09:07.450821 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-3ad472f1-6347-45a8-bfcd-f1d665d893ec tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] [instance: fa6a7a92-a9c5-41a4-b8d4-356787a243bc] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:09:07.457136 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-3ad472f1-6347-45a8-bfcd-f1d665d893ec tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:09:07.457911 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-3ad472f1-6347-45a8-bfcd-f1d665d893ec tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:09:07.458978 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-3ad472f1-6347-45a8-bfcd-f1d665d893ec tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:09:07.459677 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-3ad472f1-6347-45a8-bfcd-f1d665d893ec tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:09:07.573720 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-6783d4a7-4268-4917-bc6e-e887bc742803 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abc2e04754884398afc999d423e2a711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2940ca71c4b24b5facc194b61d748a11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:09:07.582550 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-6783d4a7-4268-4917-bc6e-e887bc742803 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] 10.222.0.20 "GET /compute/v2.1/servers/30391772-c0aa-468b-a414-c40c716a2481" status: 200 len: 1756 microversion: 2.1 time: 0.184036 Jul 01 04:09:07.583455 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 245/501] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:09:07 2022] GET /compute/v2.1/servers/30391772-c0aa-468b-a414-c40c716a2481 => generated 1756 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:09:07.665822 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-3ad472f1-6347-45a8-bfcd-f1d665d893ec tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021817b0eef94fc2a19d90c511ec9298', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87ca5d9f50847d6ab501ca3a51ab37c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:09:07.674345 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-3ad472f1-6347-45a8-bfcd-f1d665d893ec tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] 10.222.0.20 "GET /compute/v2.1/servers/fa6a7a92-a9c5-41a4-b8d4-356787a243bc" status: 200 len: 1319 microversion: 2.1 time: 0.228270 Jul 01 04:09:07.674927 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 257/502] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:09:07 2022] GET /compute/v2.1/servers/fa6a7a92-a9c5-41a4-b8d4-356787a243bc => generated 1319 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 04:09:07.904587 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [req-1f6617bc-bf7d-4389-8e12-1c0a6bd1d1aa req-93758b75-c3f4-4e49-840f-5cee83efec61 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fa6a7a92-a9c5-41a4-b8d4-356787a243bc", "tag": "0312ab03-cc44-4db7-ba4a-0ac3db603bcb"}]} {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 04:09:07.920110 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [req-1f6617bc-bf7d-4389-8e12-1c0a6bd1d1aa req-93758b75-c3f4-4e49-840f-5cee83efec61 service nova] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:09:07.920919 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [req-1f6617bc-bf7d-4389-8e12-1c0a6bd1d1aa req-93758b75-c3f4-4e49-840f-5cee83efec61 service nova] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:09:07.936413 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.compute.server_external_events [req-1f6617bc-bf7d-4389-8e12-1c0a6bd1d1aa req-93758b75-c3f4-4e49-840f-5cee83efec61 service nova] Creating event network-changed:0312ab03-cc44-4db7-ba4a-0ac3db603bcb for instance fa6a7a92-a9c5-41a4-b8d4-356787a243bc on hv-cinder-84684 Jul 01 04:09:07.941808 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [req-1f6617bc-bf7d-4389-8e12-1c0a6bd1d1aa req-93758b75-c3f4-4e49-840f-5cee83efec61 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047089 Jul 01 04:09:07.942424 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 246/503] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Jul 1 04:09:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 04:09:08.162610 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-a5063443-c0eb-4a14-9b78-356ef468a537 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:09:08.164323 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-a5063443-c0eb-4a14-9b78-356ef468a537 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] [instance: b904f233-887c-4c96-a2d2-f7f415ad852f] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:09:08.172163 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-a5063443-c0eb-4a14-9b78-356ef468a537 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:09:08.172700 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-a5063443-c0eb-4a14-9b78-356ef468a537 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:09:08.173765 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-a5063443-c0eb-4a14-9b78-356ef468a537 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:09:08.174291 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-a5063443-c0eb-4a14-9b78-356ef468a537 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:09:08.209862 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-a5063443-c0eb-4a14-9b78-356ef468a537 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] 10.222.0.20 "GET /compute/v2.1/servers/b904f233-887c-4c96-a2d2-f7f415ad852f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051804 Jul 01 04:09:08.211058 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 258/504] 10.222.0.20 () {60 vars in 1342 bytes} [Fri Jul 1 04:09:08 2022] GET /compute/v2.1/servers/b904f233-887c-4c96-a2d2-f7f415ad852f/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 01 04:09:08.660065 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-bf5a9838-d8eb-4955-943a-8fdd952d1e2d tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:09:08.660769 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-bf5a9838-d8eb-4955-943a-8fdd952d1e2d tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] [instance: 30391772-c0aa-468b-a414-c40c716a2481] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:09:08.674065 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-bf5a9838-d8eb-4955-943a-8fdd952d1e2d tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:09:08.674558 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-bf5a9838-d8eb-4955-943a-8fdd952d1e2d tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:09:08.675338 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-bf5a9838-d8eb-4955-943a-8fdd952d1e2d tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:09:08.675789 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-bf5a9838-d8eb-4955-943a-8fdd952d1e2d tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:09:08.701426 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-3c532af9-1d00-4704-a9e1-d2727a20b731 tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:09:08.702319 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-3c532af9-1d00-4704-a9e1-d2727a20b731 tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] [instance: fa6a7a92-a9c5-41a4-b8d4-356787a243bc] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:09:08.718428 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-3c532af9-1d00-4704-a9e1-d2727a20b731 tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:09:08.720438 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-3c532af9-1d00-4704-a9e1-d2727a20b731 tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:09:08.724039 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-3c532af9-1d00-4704-a9e1-d2727a20b731 tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:09:08.728816 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-3c532af9-1d00-4704-a9e1-d2727a20b731 tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:09:08.757697 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG dbcounter [-] [118712] Writing DB stats nova_cell1:SELECT=100 {{(pid=118712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:09:08.899121 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-3c532af9-1d00-4704-a9e1-d2727a20b731 tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021817b0eef94fc2a19d90c511ec9298', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87ca5d9f50847d6ab501ca3a51ab37c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:09:08.908158 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-3c532af9-1d00-4704-a9e1-d2727a20b731 tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] 10.222.0.20 "GET /compute/v2.1/servers/fa6a7a92-a9c5-41a4-b8d4-356787a243bc" status: 200 len: 1319 microversion: 2.1 time: 0.218309 Jul 01 04:09:08.909502 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 259/505] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:09:08 2022] GET /compute/v2.1/servers/fa6a7a92-a9c5-41a4-b8d4-356787a243bc => generated 1319 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:09:08.917277 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [req-2a5063a7-cd44-4aab-bb67-2399a41057ae req-2db71d1e-c9c9-45ae-a79b-5f633789281d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "246ef166-ec68-4657-b7b2-529c41cb4429", "tag": "706047c1-eb46-4189-838b-5b3bd921b5c5"}]} {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 04:09:08.927028 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [req-2a5063a7-cd44-4aab-bb67-2399a41057ae req-2db71d1e-c9c9-45ae-a79b-5f633789281d service nova] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:09:08.927504 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [req-2a5063a7-cd44-4aab-bb67-2399a41057ae req-2db71d1e-c9c9-45ae-a79b-5f633789281d service nova] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:09:08.936171 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-bf5a9838-d8eb-4955-943a-8fdd952d1e2d tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abc2e04754884398afc999d423e2a711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2940ca71c4b24b5facc194b61d748a11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:09:08.942530 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.compute.server_external_events [req-2a5063a7-cd44-4aab-bb67-2399a41057ae req-2db71d1e-c9c9-45ae-a79b-5f633789281d service nova] Creating event network-changed:706047c1-eb46-4189-838b-5b3bd921b5c5 for instance 246ef166-ec68-4657-b7b2-529c41cb4429 on hv-cinder-84684 Jul 01 04:09:08.948198 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-bf5a9838-d8eb-4955-943a-8fdd952d1e2d tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] 10.222.0.20 "GET /compute/v2.1/servers/30391772-c0aa-468b-a414-c40c716a2481" status: 200 len: 1756 microversion: 2.1 time: 0.292191 Jul 01 04:09:08.948848 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 247/506] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:09:08 2022] GET /compute/v2.1/servers/30391772-c0aa-468b-a414-c40c716a2481 => generated 1756 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:09:08.957900 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [req-2a5063a7-cd44-4aab-bb67-2399a41057ae req-2db71d1e-c9c9-45ae-a79b-5f633789281d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038151 Jul 01 04:09:08.957900 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 260/507] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Jul 1 04:09:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 04:09:09.224222 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-15021eda-8f16-49f4-98e3-0f6e27059af1 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:09:09.225150 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-15021eda-8f16-49f4-98e3-0f6e27059af1 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] [instance: b904f233-887c-4c96-a2d2-f7f415ad852f] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:09:09.232751 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-15021eda-8f16-49f4-98e3-0f6e27059af1 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:09:09.233203 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-15021eda-8f16-49f4-98e3-0f6e27059af1 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:09:09.233982 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-15021eda-8f16-49f4-98e3-0f6e27059af1 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:09:09.234413 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-15021eda-8f16-49f4-98e3-0f6e27059af1 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:09:09.267008 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-15021eda-8f16-49f4-98e3-0f6e27059af1 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] 10.222.0.20 "GET /compute/v2.1/servers/b904f233-887c-4c96-a2d2-f7f415ad852f/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.047831 Jul 01 04:09:09.267661 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 261/508] 10.222.0.20 () {60 vars in 1342 bytes} [Fri Jul 1 04:09:09 2022] GET /compute/v2.1/servers/b904f233-887c-4c96-a2d2-f7f415ad852f/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:09:09.343032 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-07daecca-be82-427b-88ae-ae2f9b238182 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:09:09.343558 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-07daecca-be82-427b-88ae-ae2f9b238182 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] [instance: b904f233-887c-4c96-a2d2-f7f415ad852f] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:09:09.350060 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-07daecca-be82-427b-88ae-ae2f9b238182 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:09:09.350538 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-07daecca-be82-427b-88ae-ae2f9b238182 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:09:09.351342 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-07daecca-be82-427b-88ae-ae2f9b238182 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:09:09.352180 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-07daecca-be82-427b-88ae-ae2f9b238182 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:09:09.380936 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-07daecca-be82-427b-88ae-ae2f9b238182 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] [instance: b904f233-887c-4c96-a2d2-f7f415ad852f] Going to try to terminate instance {{(pid=118711) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 01 04:09:09.773262 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-07daecca-be82-427b-88ae-ae2f9b238182 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] 10.222.0.20 "DELETE /compute/v2.1/servers/b904f233-887c-4c96-a2d2-f7f415ad852f" status: 204 len: 0 microversion: 2.20 time: 0.435013 Jul 01 04:09:09.774368 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 248/509] 10.222.0.20 () {60 vars in 1279 bytes} [Fri Jul 1 04:09:09 2022] DELETE /compute/v2.1/servers/b904f233-887c-4c96-a2d2-f7f415ad852f => generated 0 bytes in 437 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 01 04:09:09.786538 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-774c8d46-75e6-4254-8d97-a1c49f92ce37 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:09:09.787770 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-774c8d46-75e6-4254-8d97-a1c49f92ce37 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] [instance: b904f233-887c-4c96-a2d2-f7f415ad852f] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:09:09.805569 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-774c8d46-75e6-4254-8d97-a1c49f92ce37 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:09:09.812101 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-774c8d46-75e6-4254-8d97-a1c49f92ce37 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:09:09.813604 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-774c8d46-75e6-4254-8d97-a1c49f92ce37 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:09:09.814063 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-774c8d46-75e6-4254-8d97-a1c49f92ce37 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:09:09.926832 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-8bb10d10-bdaa-499d-9351-ef64b226968b tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:09:09.927781 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-8bb10d10-bdaa-499d-9351-ef64b226968b tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] [instance: fa6a7a92-a9c5-41a4-b8d4-356787a243bc] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:09:09.935966 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-8bb10d10-bdaa-499d-9351-ef64b226968b tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:09:09.936415 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-8bb10d10-bdaa-499d-9351-ef64b226968b tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:09:09.937202 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-8bb10d10-bdaa-499d-9351-ef64b226968b tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:09:09.937646 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-8bb10d10-bdaa-499d-9351-ef64b226968b tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:09:09.968278 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-774c8d46-75e6-4254-8d97-a1c49f92ce37 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:09:09.976621 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-774c8d46-75e6-4254-8d97-a1c49f92ce37 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:09:09.978115 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-774c8d46-75e6-4254-8d97-a1c49f92ce37 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:09:09.979463 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-774c8d46-75e6-4254-8d97-a1c49f92ce37 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] 10.222.0.20 "GET /compute/v2.1/servers/b904f233-887c-4c96-a2d2-f7f415ad852f" status: 200 len: 1723 microversion: 2.20 time: 0.199208 Jul 01 04:09:09.980023 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 262/510] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Jul 1 04:09:09 2022] GET /compute/v2.1/servers/b904f233-887c-4c96-a2d2-f7f415ad852f => generated 1723 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 04:09:09.987114 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-85b39de1-64a8-4033-9b8d-5b9082e51c6c tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:09:09.988605 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-85b39de1-64a8-4033-9b8d-5b9082e51c6c tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] [instance: 30391772-c0aa-468b-a414-c40c716a2481] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:09:10.001634 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-85b39de1-64a8-4033-9b8d-5b9082e51c6c tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:09:10.002185 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-85b39de1-64a8-4033-9b8d-5b9082e51c6c tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:09:10.003358 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-85b39de1-64a8-4033-9b8d-5b9082e51c6c tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:09:10.005180 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-85b39de1-64a8-4033-9b8d-5b9082e51c6c tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:09:10.099624 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-8bb10d10-bdaa-499d-9351-ef64b226968b tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021817b0eef94fc2a19d90c511ec9298', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87ca5d9f50847d6ab501ca3a51ab37c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:09:10.115869 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-8bb10d10-bdaa-499d-9351-ef64b226968b tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] 10.222.0.20 "GET /compute/v2.1/servers/fa6a7a92-a9c5-41a4-b8d4-356787a243bc" status: 200 len: 1319 microversion: 2.1 time: 0.187082 Jul 01 04:09:10.117244 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 249/511] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:09:09 2022] GET /compute/v2.1/servers/fa6a7a92-a9c5-41a4-b8d4-356787a243bc => generated 1319 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 04:09:10.202356 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-85b39de1-64a8-4033-9b8d-5b9082e51c6c tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abc2e04754884398afc999d423e2a711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2940ca71c4b24b5facc194b61d748a11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:09:10.211165 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-85b39de1-64a8-4033-9b8d-5b9082e51c6c tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] 10.222.0.20 "GET /compute/v2.1/servers/30391772-c0aa-468b-a414-c40c716a2481" status: 200 len: 1756 microversion: 2.1 time: 0.229865 Jul 01 04:09:10.211869 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 263/512] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:09:09 2022] GET /compute/v2.1/servers/30391772-c0aa-468b-a414-c40c716a2481 => generated 1756 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:09:10.998591 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-68cc5bdb-c130-42cc-bbd7-133f8e9a1538 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:09:10.999214 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-68cc5bdb-c130-42cc-bbd7-133f8e9a1538 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] [instance: b904f233-887c-4c96-a2d2-f7f415ad852f] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:09:11.001425 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG dbcounter [-] [118711] Writing DB stats nova_cell0:SELECT=2 {{(pid=118711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:09:11.003412 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG dbcounter [-] [118711] Writing DB stats nova_cell0:SELECT=8 {{(pid=118711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:09:11.010755 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-68cc5bdb-c130-42cc-bbd7-133f8e9a1538 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:09:11.011346 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-68cc5bdb-c130-42cc-bbd7-133f8e9a1538 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:09:11.012348 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-68cc5bdb-c130-42cc-bbd7-133f8e9a1538 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:09:11.013122 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-68cc5bdb-c130-42cc-bbd7-133f8e9a1538 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:09:11.136658 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-3a860b11-049a-4e47-802f-1b6f7a4da50f tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:09:11.137770 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-3a860b11-049a-4e47-802f-1b6f7a4da50f tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] [instance: fa6a7a92-a9c5-41a4-b8d4-356787a243bc] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:09:11.151264 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-3a860b11-049a-4e47-802f-1b6f7a4da50f tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:09:11.151264 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-3a860b11-049a-4e47-802f-1b6f7a4da50f tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:09:11.152300 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-3a860b11-049a-4e47-802f-1b6f7a4da50f tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:09:11.153372 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-3a860b11-049a-4e47-802f-1b6f7a4da50f tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:09:11.237334 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-68cc5bdb-c130-42cc-bbd7-133f8e9a1538 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:09:11.249138 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-68cc5bdb-c130-42cc-bbd7-133f8e9a1538 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:09:11.251265 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-68cc5bdb-c130-42cc-bbd7-133f8e9a1538 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:09:11.252541 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-68cc5bdb-c130-42cc-bbd7-133f8e9a1538 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] 10.222.0.20 "GET /compute/v2.1/servers/b904f233-887c-4c96-a2d2-f7f415ad852f" status: 200 len: 1723 microversion: 2.20 time: 0.258251 Jul 01 04:09:11.253309 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 250/513] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Jul 1 04:09:10 2022] GET /compute/v2.1/servers/b904f233-887c-4c96-a2d2-f7f415ad852f => generated 1723 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 04:09:11.258189 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-776088bc-1e1c-479a-836e-e0c9e9c03cdd tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:09:11.259041 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-776088bc-1e1c-479a-836e-e0c9e9c03cdd tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] [instance: 30391772-c0aa-468b-a414-c40c716a2481] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:09:11.265899 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-776088bc-1e1c-479a-836e-e0c9e9c03cdd tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:09:11.266612 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-776088bc-1e1c-479a-836e-e0c9e9c03cdd tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:09:11.267462 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-776088bc-1e1c-479a-836e-e0c9e9c03cdd tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:09:11.267901 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-776088bc-1e1c-479a-836e-e0c9e9c03cdd tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:09:11.311843 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-3a860b11-049a-4e47-802f-1b6f7a4da50f tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021817b0eef94fc2a19d90c511ec9298', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87ca5d9f50847d6ab501ca3a51ab37c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:09:11.325295 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-3a860b11-049a-4e47-802f-1b6f7a4da50f tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] 10.222.0.20 "GET /compute/v2.1/servers/fa6a7a92-a9c5-41a4-b8d4-356787a243bc" status: 200 len: 1319 microversion: 2.1 time: 0.194211 Jul 01 04:09:11.326145 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 264/514] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:09:11 2022] GET /compute/v2.1/servers/fa6a7a92-a9c5-41a4-b8d4-356787a243bc => generated 1319 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:09:11.848734 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-776088bc-1e1c-479a-836e-e0c9e9c03cdd tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abc2e04754884398afc999d423e2a711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2940ca71c4b24b5facc194b61d748a11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:09:11.857469 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-776088bc-1e1c-479a-836e-e0c9e9c03cdd tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] 10.222.0.20 "GET /compute/v2.1/servers/30391772-c0aa-468b-a414-c40c716a2481" status: 200 len: 1756 microversion: 2.1 time: 0.602824 Jul 01 04:09:11.858082 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 251/515] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:09:11 2022] GET /compute/v2.1/servers/30391772-c0aa-468b-a414-c40c716a2481 => generated 1756 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:09:12.271814 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG dbcounter [-] [118712] Writing DB stats nova_cell0:SELECT=2 {{(pid=118712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:09:12.278832 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-9ba24696-9e8f-4f14-a9d7-565ab74b4e1a tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:09:12.279544 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-9ba24696-9e8f-4f14-a9d7-565ab74b4e1a tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] [instance: b904f233-887c-4c96-a2d2-f7f415ad852f] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:09:12.286453 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-9ba24696-9e8f-4f14-a9d7-565ab74b4e1a tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:09:12.287066 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-9ba24696-9e8f-4f14-a9d7-565ab74b4e1a tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:09:12.287695 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-9ba24696-9e8f-4f14-a9d7-565ab74b4e1a tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:09:12.288133 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-9ba24696-9e8f-4f14-a9d7-565ab74b4e1a tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:09:12.348579 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-3fe882d8-22cf-400f-80f8-9979d94a2c01 tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:09:12.349198 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-3fe882d8-22cf-400f-80f8-9979d94a2c01 tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] [instance: fa6a7a92-a9c5-41a4-b8d4-356787a243bc] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:09:12.357848 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-3fe882d8-22cf-400f-80f8-9979d94a2c01 tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:09:12.358317 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-3fe882d8-22cf-400f-80f8-9979d94a2c01 tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:09:12.359095 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-3fe882d8-22cf-400f-80f8-9979d94a2c01 tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:09:12.359557 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-3fe882d8-22cf-400f-80f8-9979d94a2c01 tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:09:12.507811 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-3fe882d8-22cf-400f-80f8-9979d94a2c01 tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021817b0eef94fc2a19d90c511ec9298', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87ca5d9f50847d6ab501ca3a51ab37c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:09:12.516295 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-3fe882d8-22cf-400f-80f8-9979d94a2c01 tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] 10.222.0.20 "GET /compute/v2.1/servers/fa6a7a92-a9c5-41a4-b8d4-356787a243bc" status: 200 len: 1319 microversion: 2.1 time: 0.177600 Jul 01 04:09:12.525929 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 252/516] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:09:12 2022] GET /compute/v2.1/servers/fa6a7a92-a9c5-41a4-b8d4-356787a243bc => generated 1319 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:09:12.633494 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-9ba24696-9e8f-4f14-a9d7-565ab74b4e1a tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:09:12.642990 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-9ba24696-9e8f-4f14-a9d7-565ab74b4e1a tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:09:12.645581 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-9ba24696-9e8f-4f14-a9d7-565ab74b4e1a tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:09:12.646787 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-9ba24696-9e8f-4f14-a9d7-565ab74b4e1a tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] 10.222.0.20 "GET /compute/v2.1/servers/b904f233-887c-4c96-a2d2-f7f415ad852f" status: 200 len: 1723 microversion: 2.20 time: 0.376241 Jul 01 04:09:12.647582 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 265/517] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Jul 1 04:09:12 2022] GET /compute/v2.1/servers/b904f233-887c-4c96-a2d2-f7f415ad852f => generated 1723 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 04:09:12.876269 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-88c0a42c-1b6d-49f5-b564-bc5818f3474f tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:09:12.876881 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-88c0a42c-1b6d-49f5-b564-bc5818f3474f tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] [instance: 30391772-c0aa-468b-a414-c40c716a2481] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:09:12.883500 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-88c0a42c-1b6d-49f5-b564-bc5818f3474f tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:09:12.883960 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-88c0a42c-1b6d-49f5-b564-bc5818f3474f tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:09:12.885267 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-88c0a42c-1b6d-49f5-b564-bc5818f3474f tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:09:12.885682 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-88c0a42c-1b6d-49f5-b564-bc5818f3474f tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:09:12.910177 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [req-3d1aa00d-c3ff-4240-afa1-d9d2595b9b82 req-505b3889-25a7-4d88-9c1c-eb2add1c80d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa6a7a92-a9c5-41a4-b8d4-356787a243bc", "name": "network-vif-plugged", "status": "completed", "tag": "0312ab03-cc44-4db7-ba4a-0ac3db603bcb"}]} {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 04:09:12.921974 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [req-3d1aa00d-c3ff-4240-afa1-d9d2595b9b82 req-505b3889-25a7-4d88-9c1c-eb2add1c80d4 service nova] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:09:12.922752 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [req-3d1aa00d-c3ff-4240-afa1-d9d2595b9b82 req-505b3889-25a7-4d88-9c1c-eb2add1c80d4 service nova] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:09:12.934905 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.compute.server_external_events [req-3d1aa00d-c3ff-4240-afa1-d9d2595b9b82 req-505b3889-25a7-4d88-9c1c-eb2add1c80d4 service nova] Creating event network-vif-plugged:0312ab03-cc44-4db7-ba4a-0ac3db603bcb for instance fa6a7a92-a9c5-41a4-b8d4-356787a243bc on hv-cinder-84684 Jul 01 04:09:12.940845 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [req-3d1aa00d-c3ff-4240-afa1-d9d2595b9b82 req-505b3889-25a7-4d88-9c1c-eb2add1c80d4 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037861 Jul 01 04:09:12.941599 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 266/518] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Jul 1 04:09:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 04:09:13.058837 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-88c0a42c-1b6d-49f5-b564-bc5818f3474f tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abc2e04754884398afc999d423e2a711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2940ca71c4b24b5facc194b61d748a11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:09:13.073182 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-88c0a42c-1b6d-49f5-b564-bc5818f3474f tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] 10.222.0.20 "GET /compute/v2.1/servers/30391772-c0aa-468b-a414-c40c716a2481" status: 200 len: 1756 microversion: 2.1 time: 0.198918 Jul 01 04:09:13.085159 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 253/519] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:09:12 2022] GET /compute/v2.1/servers/30391772-c0aa-468b-a414-c40c716a2481 => generated 1756 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:09:13.123633 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [req-1b56d9c9-7a48-4033-94e0-e4b3440a7b9b req-9941bed0-2c1d-485c-b61a-84c0bb030c30 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b904f233-887c-4c96-a2d2-f7f415ad852f", "name": "network-vif-deleted", "tag": "b1d88871-2b18-4397-8234-7831054c30f0"}]} {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 04:09:13.132318 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [req-1b56d9c9-7a48-4033-94e0-e4b3440a7b9b req-9941bed0-2c1d-485c-b61a-84c0bb030c30 service nova] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:09:13.134018 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [req-1b56d9c9-7a48-4033-94e0-e4b3440a7b9b req-9941bed0-2c1d-485c-b61a-84c0bb030c30 service nova] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:09:13.146601 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.compute.server_external_events [req-1b56d9c9-7a48-4033-94e0-e4b3440a7b9b req-9941bed0-2c1d-485c-b61a-84c0bb030c30 service nova] Creating event network-vif-deleted:b1d88871-2b18-4397-8234-7831054c30f0 for instance b904f233-887c-4c96-a2d2-f7f415ad852f on hv-cinder-84684 Jul 01 04:09:13.151955 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [req-1b56d9c9-7a48-4033-94e0-e4b3440a7b9b req-9941bed0-2c1d-485c-b61a-84c0bb030c30 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032789 Jul 01 04:09:13.152654 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 267/520] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Jul 1 04:09:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 04:09:13.533532 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-544e5b58-ae8d-4cb0-a5ff-d72f911c3f8f tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:09:13.534454 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-544e5b58-ae8d-4cb0-a5ff-d72f911c3f8f tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] [instance: fa6a7a92-a9c5-41a4-b8d4-356787a243bc] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:09:13.568245 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-544e5b58-ae8d-4cb0-a5ff-d72f911c3f8f tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:09:13.570304 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-544e5b58-ae8d-4cb0-a5ff-d72f911c3f8f tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:09:13.571437 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-544e5b58-ae8d-4cb0-a5ff-d72f911c3f8f tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:09:13.574587 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-544e5b58-ae8d-4cb0-a5ff-d72f911c3f8f tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:09:13.668281 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-db3cda09-ec5c-4963-abad-7966f4d96244 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:09:13.670140 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-db3cda09-ec5c-4963-abad-7966f4d96244 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] [instance: b904f233-887c-4c96-a2d2-f7f415ad852f] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:09:13.681160 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-db3cda09-ec5c-4963-abad-7966f4d96244 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:09:13.681922 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-db3cda09-ec5c-4963-abad-7966f4d96244 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:09:13.682960 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-db3cda09-ec5c-4963-abad-7966f4d96244 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:09:13.683427 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-db3cda09-ec5c-4963-abad-7966f4d96244 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:09:13.734956 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-db3cda09-ec5c-4963-abad-7966f4d96244 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:09:13.735706 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-db3cda09-ec5c-4963-abad-7966f4d96244 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:09:13.736271 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.objects.instance [None req-db3cda09-ec5c-4963-abad-7966f4d96244 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lazy-loading 'fault' on Instance uuid b904f233-887c-4c96-a2d2-f7f415ad852f {{(pid=118712) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 04:09:13.759630 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-544e5b58-ae8d-4cb0-a5ff-d72f911c3f8f tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021817b0eef94fc2a19d90c511ec9298', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87ca5d9f50847d6ab501ca3a51ab37c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:09:13.769675 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-544e5b58-ae8d-4cb0-a5ff-d72f911c3f8f tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] 10.222.0.20 "GET /compute/v2.1/servers/fa6a7a92-a9c5-41a4-b8d4-356787a243bc" status: 200 len: 1319 microversion: 2.1 time: 0.240502 Jul 01 04:09:13.770576 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 254/521] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:09:13 2022] GET /compute/v2.1/servers/fa6a7a92-a9c5-41a4-b8d4-356787a243bc => generated 1319 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:09:13.800056 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-db3cda09-ec5c-4963-abad-7966f4d96244 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:09:13.809671 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-db3cda09-ec5c-4963-abad-7966f4d96244 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:09:13.812091 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-db3cda09-ec5c-4963-abad-7966f4d96244 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:09:13.813819 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-db3cda09-ec5c-4963-abad-7966f4d96244 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] 10.222.0.20 "GET /compute/v2.1/servers/b904f233-887c-4c96-a2d2-f7f415ad852f" status: 200 len: 1372 microversion: 2.20 time: 0.150435 Jul 01 04:09:13.814903 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 268/522] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Jul 1 04:09:13 2022] GET /compute/v2.1/servers/b904f233-887c-4c96-a2d2-f7f415ad852f => generated 1372 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 01 04:09:14.090293 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-d2efe457-5faa-47b0-9a30-e6672b88a432 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:09:14.091003 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-d2efe457-5faa-47b0-9a30-e6672b88a432 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] [instance: 30391772-c0aa-468b-a414-c40c716a2481] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:09:14.097504 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-d2efe457-5faa-47b0-9a30-e6672b88a432 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:09:14.097965 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-d2efe457-5faa-47b0-9a30-e6672b88a432 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:09:14.098730 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-d2efe457-5faa-47b0-9a30-e6672b88a432 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:09:14.099169 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-d2efe457-5faa-47b0-9a30-e6672b88a432 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:09:14.120730 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG dbcounter [-] [118711] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=118711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:09:14.265406 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-d2efe457-5faa-47b0-9a30-e6672b88a432 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abc2e04754884398afc999d423e2a711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2940ca71c4b24b5facc194b61d748a11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:09:14.273234 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-d2efe457-5faa-47b0-9a30-e6672b88a432 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] 10.222.0.20 "GET /compute/v2.1/servers/30391772-c0aa-468b-a414-c40c716a2481" status: 200 len: 1756 microversion: 2.1 time: 0.187089 Jul 01 04:09:14.275467 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 255/523] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:09:14 2022] GET /compute/v2.1/servers/30391772-c0aa-468b-a414-c40c716a2481 => generated 1756 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:09:14.787956 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-ede18826-e3d5-4ea0-aac0-ab059dffb4e3 tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:09:14.788607 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-ede18826-e3d5-4ea0-aac0-ab059dffb4e3 tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] [instance: fa6a7a92-a9c5-41a4-b8d4-356787a243bc] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:09:14.796849 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-ede18826-e3d5-4ea0-aac0-ab059dffb4e3 tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:09:14.797403 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-ede18826-e3d5-4ea0-aac0-ab059dffb4e3 tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:09:14.798405 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-ede18826-e3d5-4ea0-aac0-ab059dffb4e3 tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:09:14.798807 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-ede18826-e3d5-4ea0-aac0-ab059dffb4e3 tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:09:14.833619 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-eca8ea06-ff2c-4e95-9899-cb88815075d6 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:09:14.838394 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-eca8ea06-ff2c-4e95-9899-cb88815075d6 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] [instance: b904f233-887c-4c96-a2d2-f7f415ad852f] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:09:14.846155 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-eca8ea06-ff2c-4e95-9899-cb88815075d6 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:09:14.846619 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-eca8ea06-ff2c-4e95-9899-cb88815075d6 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:09:14.847609 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-eca8ea06-ff2c-4e95-9899-cb88815075d6 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:09:14.848100 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-eca8ea06-ff2c-4e95-9899-cb88815075d6 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:09:14.865147 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.wsgi [None req-eca8ea06-ff2c-4e95-9899-cb88815075d6 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] HTTP exception thrown: Instance b904f233-887c-4c96-a2d2-f7f415ad852f could not be found. Jul 01 04:09:14.866893 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-eca8ea06-ff2c-4e95-9899-cb88815075d6 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Request method failure captured: Jul 01 04:09:14.866893 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: request: GET /compute/v2.1/servers/b904f233-887c-4c96-a2d2-f7f415ad852f HTTP/1.1 Jul 01 04:09:14.866893 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: Accept: application/json Jul 01 04:09:14.866893 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: Accept-Encoding: identity Jul 01 04:09:14.866893 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: Connection: close Jul 01 04:09:14.866893 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: Content-Length: 0 Jul 01 04:09:14.866893 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: Content-Type: application/json Jul 01 04:09:14.866893 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: Host: 10.222.0.20 Jul 01 04:09:14.866893 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: Openstack-System-Scope: None Jul 01 04:09:14.866893 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: User-Agent: python-urllib3/1.26.9 Jul 01 04:09:14.866893 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-Auth-Token: gAAAAABivnJbJtk-Vdr0TH6YVzrkZXSnd-ckPdCFGsFrMW1Xw0J4UduqBITIxqEad-NvPnhYvwjorMjp4X6BuD4OM6xff3u5B2Kkus3vTB-CIXf57EnqC1pcB4n4Ei5LlEl74ZlzNCFsv8iBmA2wlq3q32_Sk0Mmn9JFvndIa4I5_mcJ6fN4ZG8 Jul 01 04:09:14.866893 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-Domain-Id: None Jul 01 04:09:14.866893 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-Domain-Name: None Jul 01 04:09:14.866893 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-Identity-Status: Confirmed Jul 01 04:09:14.866893 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-Is-Admin-Project: True Jul 01 04:09:14.866893 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-Openstack-Nova-Api-Version: 2.20 Jul 01 04:09:14.866893 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-Project-Domain-Id: default Jul 01 04:09:14.866893 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-Project-Domain-Name: Default Jul 01 04:09:14.866893 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-Project-Id: 9dccdb0188264f2686d7275e19f39d05 Jul 01 04:09:14.866893 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1029725038 Jul 01 04:09:14.866893 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-Role: reader,member Jul 01 04:09:14.866893 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-Roles: reader,member Jul 01 04:09:14.868612 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/9dccdb0188264f2686d7275e19f39d05"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_9dccdb0188264f2686d7275e19f39d05", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9dccdb0188264f2686d7275e19f39d05"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9dccdb0188264f2686d7275e19f39d05"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}] Jul 01 04:09:14.868612 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1029725038 Jul 01 04:09:14.868612 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-Tenant-Id: 9dccdb0188264f2686d7275e19f39d05 Jul 01 04:09:14.868612 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1029725038 Jul 01 04:09:14.868612 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-User: tempest-AttachVolumeShelveTestJSON-1029725038-project Jul 01 04:09:14.868612 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-User-Domain-Id: default Jul 01 04:09:14.868612 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-User-Domain-Name: Default Jul 01 04:09:14.868612 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-User-Id: 708734ba3ddc49a3a9dba1d891aeccc7 Jul 01 04:09:14.868612 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1029725038-project Jul 01 04:09:14.868612 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: method: > Jul 01 04:09:14.868612 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: exception: Instance b904f233-887c-4c96-a2d2-f7f415ad852f could not be found. Jul 01 04:09:14.868612 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: action_args: {'id': 'b904f233-887c-4c96-a2d2-f7f415ad852f'} Jul 01 04:09:14.869403 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 04:09:14.869403 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 04:09:14.869403 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 04:09:14.869403 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 04:09:14.869403 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 04:09:14.869403 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 04:09:14.869403 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 04:09:14.869403 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 04:09:14.869403 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 04:09:14.869403 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 04:09:14.869403 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b904f233-887c-4c96-a2d2-f7f415ad852f could not be found. Jul 01 04:09:14.869403 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi Jul 01 04:09:14.869403 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 04:09:14.869403 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi Jul 01 04:09:14.869403 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 04:09:14.869403 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 04:09:14.869403 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 04:09:14.869403 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 04:09:14.869403 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 04:09:14.869403 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 04:09:14.870571 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 04:09:14.870571 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 04:09:14.870571 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 04:09:14.870571 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 04:09:14.870571 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 04:09:14.870571 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 04:09:14.870571 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 04:09:14.870571 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b904f233-887c-4c96-a2d2-f7f415ad852f could not be found. Jul 01 04:09:14.870571 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi Jul 01 04:09:14.870571 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 04:09:14.870571 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi Jul 01 04:09:14.870571 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 04:09:14.870571 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 04:09:14.870571 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 04:09:14.870571 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 04:09:14.870571 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 04:09:14.870571 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b904f233-887c-4c96-a2d2-f7f415ad852f could not be found. Jul 01 04:09:14.870571 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi Jul 01 04:09:14.871711 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-eca8ea06-ff2c-4e95-9899-cb88815075d6 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Returning 404 to user: Instance b904f233-887c-4c96-a2d2-f7f415ad852f could not be found. {{(pid=118711) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 04:09:14.871711 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-eca8ea06-ff2c-4e95-9899-cb88815075d6 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] 10.222.0.20 "GET /compute/v2.1/servers/b904f233-887c-4c96-a2d2-f7f415ad852f" status: 404 len: 111 microversion: 2.20 time: 0.038794 Jul 01 04:09:14.871711 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 256/524] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Jul 1 04:09:14 2022] GET /compute/v2.1/servers/b904f233-887c-4c96-a2d2-f7f415ad852f => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jul 01 04:09:14.878933 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-4d6f5d4a-35b6-4df4-9ccb-9b6d5709ec2c tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Calling method '.version_select at 0x7f99a30a0790>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:09:14.949443 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-ede18826-e3d5-4ea0-aac0-ab059dffb4e3 tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021817b0eef94fc2a19d90c511ec9298', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87ca5d9f50847d6ab501ca3a51ab37c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:09:14.955390 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-4d6f5d4a-35b6-4df4-9ccb-9b6d5709ec2c tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1881303120" status: 204 len: 0 microversion: 2.20 time: 0.081125 Jul 01 04:09:14.956423 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 257/525] 10.222.0.20 () {60 vars in 1261 bytes} [Fri Jul 1 04:09:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1881303120 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jul 01 04:09:14.958452 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-ede18826-e3d5-4ea0-aac0-ab059dffb4e3 tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] 10.222.0.20 "GET /compute/v2.1/servers/fa6a7a92-a9c5-41a4-b8d4-356787a243bc" status: 200 len: 1319 microversion: 2.1 time: 0.174327 Jul 01 04:09:14.969566 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 269/526] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:09:14 2022] GET /compute/v2.1/servers/fa6a7a92-a9c5-41a4-b8d4-356787a243bc => generated 1319 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:09:15.297078 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-d76e9e03-71c6-4101-81a2-ed732c198ce2 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:09:15.304721 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-d76e9e03-71c6-4101-81a2-ed732c198ce2 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] [instance: 30391772-c0aa-468b-a414-c40c716a2481] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:09:15.314293 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-d76e9e03-71c6-4101-81a2-ed732c198ce2 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:09:15.314999 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-d76e9e03-71c6-4101-81a2-ed732c198ce2 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:09:15.322898 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-d76e9e03-71c6-4101-81a2-ed732c198ce2 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:09:15.323581 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-d76e9e03-71c6-4101-81a2-ed732c198ce2 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:09:15.579528 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-d76e9e03-71c6-4101-81a2-ed732c198ce2 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abc2e04754884398afc999d423e2a711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2940ca71c4b24b5facc194b61d748a11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:09:15.589198 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-d76e9e03-71c6-4101-81a2-ed732c198ce2 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] 10.222.0.20 "GET /compute/v2.1/servers/30391772-c0aa-468b-a414-c40c716a2481" status: 200 len: 1756 microversion: 2.1 time: 0.298456 Jul 01 04:09:15.592413 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 258/527] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:09:15 2022] GET /compute/v2.1/servers/30391772-c0aa-468b-a414-c40c716a2481 => generated 1756 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:09:15.853150 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-db52bb2d-8800-4489-bd13-44f9e0dc9641 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Action: 'create', calling method: .version_select at 0x7f99a0824820>, body: {"keypair": {"name": "tempest-keypair-621433929", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBALjWSHMAAyxFwX0fC7KOcPBDFJB/m4OmZ9dPc6EwxPX2X26QrdeRQ/rJTa3NHd9DA5t0xNn4L/BlBoLw8MJgfZu6gKAuh39xe3UqMn2K5myMMK+AOAcNvGNJsoG7eXVxg=="}} {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 04:09:15.870591 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.quota [None req-db52bb2d-8800-4489-bd13-44f9e0dc9641 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Getting quotas for project 9dccdb0188264f2686d7275e19f39d05. Resources: {'key_pairs'} {{(pid=118712) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 04:09:15.875953 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.quota [None req-db52bb2d-8800-4489-bd13-44f9e0dc9641 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Getting quotas for user 708734ba3ddc49a3a9dba1d891aeccc7 and project 9dccdb0188264f2686d7275e19f39d05. Resources: {'key_pairs'} {{(pid=118712) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 04:09:15.962866 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-db52bb2d-8800-4489-bd13-44f9e0dc9641 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.113509 Jul 01 04:09:15.969417 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 270/528] 10.222.0.20 () {62 vars in 1199 bytes} [Fri Jul 1 04:09:15 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 116 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 01 04:09:15.977495 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-224b90fc-680e-4d9c-acb7-0bf879cbf143 tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:09:15.978652 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-224b90fc-680e-4d9c-acb7-0bf879cbf143 tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] [instance: fa6a7a92-a9c5-41a4-b8d4-356787a243bc] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:09:15.985966 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-224b90fc-680e-4d9c-acb7-0bf879cbf143 tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:09:15.986064 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-224b90fc-680e-4d9c-acb7-0bf879cbf143 tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:09:15.986805 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-224b90fc-680e-4d9c-acb7-0bf879cbf143 tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:09:15.987279 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-224b90fc-680e-4d9c-acb7-0bf879cbf143 tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:09:16.210884 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-224b90fc-680e-4d9c-acb7-0bf879cbf143 tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021817b0eef94fc2a19d90c511ec9298', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87ca5d9f50847d6ab501ca3a51ab37c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:09:16.218601 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-224b90fc-680e-4d9c-acb7-0bf879cbf143 tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] 10.222.0.20 "GET /compute/v2.1/servers/fa6a7a92-a9c5-41a4-b8d4-356787a243bc" status: 200 len: 1507 microversion: 2.1 time: 0.245117 Jul 01 04:09:16.219356 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 259/529] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:09:15 2022] GET /compute/v2.1/servers/fa6a7a92-a9c5-41a4-b8d4-356787a243bc => generated 1507 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:09:16.240212 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-728ff66e-c304-43ea-8d19-c15a8aa74e10 tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d983a283-d95a-4906-99a0-e3ce9ac0eacc", "device": "/dev/sdb"}} {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 04:09:16.241309 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-728ff66e-c304-43ea-8d19-c15a8aa74e10 tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] [instance: fa6a7a92-a9c5-41a4-b8d4-356787a243bc] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:09:16.248706 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-728ff66e-c304-43ea-8d19-c15a8aa74e10 tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:09:16.248908 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-728ff66e-c304-43ea-8d19-c15a8aa74e10 tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:09:16.249661 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-728ff66e-c304-43ea-8d19-c15a8aa74e10 tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:09:16.250126 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-728ff66e-c304-43ea-8d19-c15a8aa74e10 tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:09:16.607144 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-c8850679-6ed9-4035-99dc-257f8efdadca tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:09:16.607911 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-c8850679-6ed9-4035-99dc-257f8efdadca tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] [instance: 30391772-c0aa-468b-a414-c40c716a2481] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:09:16.614167 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-c8850679-6ed9-4035-99dc-257f8efdadca tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:09:16.614908 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-c8850679-6ed9-4035-99dc-257f8efdadca tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:09:16.615962 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-c8850679-6ed9-4035-99dc-257f8efdadca tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:09:16.616577 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-c8850679-6ed9-4035-99dc-257f8efdadca tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:09:16.796335 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-c8850679-6ed9-4035-99dc-257f8efdadca tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abc2e04754884398afc999d423e2a711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2940ca71c4b24b5facc194b61d748a11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:09:16.804676 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-c8850679-6ed9-4035-99dc-257f8efdadca tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] 10.222.0.20 "GET /compute/v2.1/servers/30391772-c0aa-468b-a414-c40c716a2481" status: 200 len: 1759 microversion: 2.1 time: 0.201837 Jul 01 04:09:16.805322 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 260/530] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:09:16 2022] GET /compute/v2.1/servers/30391772-c0aa-468b-a414-c40c716a2481 => generated 1759 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 04:09:17.050607 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-728ff66e-c304-43ea-8d19-c15a8aa74e10 tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] 10.222.0.20 "POST /compute/v2.1/servers/fa6a7a92-a9c5-41a4-b8d4-356787a243bc/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.814097 Jul 01 04:09:17.051939 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 271/531] 10.222.0.20 () {60 vars in 1322 bytes} [Fri Jul 1 04:09:16 2022] POST /compute/v2.1/servers/fa6a7a92-a9c5-41a4-b8d4-356787a243bc/os-volume_attachments => generated 194 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 04:09:18.625746 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-7cd27787-3700-4dff-8382-459219b3d8fb tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-863631244", "imageRef": "66f9f4ba-339c-4967-8857-d65299a66629", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "7ad440ac-7067-4e8d-bf57-cf4af7de94b6"}], "security_groups": [{"name": "tempest-securitygroup--1825669607"}], "key_name": "tempest-keypair-621433929", "user_data": "}} {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 04:09:18.733339 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.network.neutron [None req-7cd27787-3700-4dff-8382-459219b3d8fb tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] validate_networks() for [('7ad440ac-7067-4e8d-bf57-cf4af7de94b6', None, None, None, None, None)] {{(pid=118711) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 01 04:09:19.137351 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.virt.hardware [None req-7cd27787-3700-4dff-8382-459219b3d8fb tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Flavor limits 0:0:0 {{(pid=118711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 01 04:09:19.137782 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.virt.hardware [None req-7cd27787-3700-4dff-8382-459219b3d8fb tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Image limits 0:0:0 {{(pid=118711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 01 04:09:19.138289 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.virt.hardware [None req-7cd27787-3700-4dff-8382-459219b3d8fb tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Flavor pref 0:0:0 {{(pid=118711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 01 04:09:19.138703 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.virt.hardware [None req-7cd27787-3700-4dff-8382-459219b3d8fb tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Image pref 0:0:0 {{(pid=118711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 01 04:09:19.139147 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.virt.hardware [None req-7cd27787-3700-4dff-8382-459219b3d8fb tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 01 04:09:19.148301 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-7cd27787-3700-4dff-8382-459219b3d8fb tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:09:19.148756 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-7cd27787-3700-4dff-8382-459219b3d8fb tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:09:19.149564 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-7cd27787-3700-4dff-8382-459219b3d8fb tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:09:19.150008 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-7cd27787-3700-4dff-8382-459219b3d8fb tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:09:19.168938 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.quota [None req-7cd27787-3700-4dff-8382-459219b3d8fb tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Getting quotas for project 9dccdb0188264f2686d7275e19f39d05. Resources: {'ram', 'cores', 'instances'} {{(pid=118711) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 04:09:19.173088 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.quota [None req-7cd27787-3700-4dff-8382-459219b3d8fb tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Getting quotas for user 708734ba3ddc49a3a9dba1d891aeccc7 and project 9dccdb0188264f2686d7275e19f39d05. Resources: {'ram', 'cores', 'instances'} {{(pid=118711) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 04:09:19.199149 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-7cd27787-3700-4dff-8382-459219b3d8fb tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Going to run 1 instances... {{(pid=118711) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 01 04:09:19.202337 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-7cd27787-3700-4dff-8382-459219b3d8fb tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] [instance: 5f84252c-dfc7-4c95-a315-5ac40d997d51] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='66f9f4ba-339c-4967-8857-d65299a66629',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118711) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 01 04:09:19.359799 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-7cd27787-3700-4dff-8382-459219b3d8fb tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.738442 Jul 01 04:09:19.360467 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 261/532] 10.222.0.20 () {62 vars in 1187 bytes} [Fri Jul 1 04:09:18 2022] POST /compute/v2.1/servers => generated 402 bytes in 740 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 01 04:09:19.372660 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-f40b15e7-6f24-460a-aed1-ec4a6e5376c3 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:09:19.373362 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-f40b15e7-6f24-460a-aed1-ec4a6e5376c3 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] [instance: 5f84252c-dfc7-4c95-a315-5ac40d997d51] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:09:19.426926 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-f40b15e7-6f24-460a-aed1-ec4a6e5376c3 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:09:19.441669 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-f40b15e7-6f24-460a-aed1-ec4a6e5376c3 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:09:19.441669 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-f40b15e7-6f24-460a-aed1-ec4a6e5376c3 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:09:19.441669 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-f40b15e7-6f24-460a-aed1-ec4a6e5376c3 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] 10.222.0.20 "GET /compute/v2.1/servers/5f84252c-dfc7-4c95-a315-5ac40d997d51" status: 200 len: 1280 microversion: 2.20 time: 0.070877 Jul 01 04:09:19.448925 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 272/533] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Jul 1 04:09:19 2022] GET /compute/v2.1/servers/5f84252c-dfc7-4c95-a315-5ac40d997d51 => generated 1280 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 01 04:09:20.456501 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-5647fedb-bcbb-4665-b6c0-dcca54b93fe8 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:09:20.457037 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-5647fedb-bcbb-4665-b6c0-dcca54b93fe8 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] [instance: 5f84252c-dfc7-4c95-a315-5ac40d997d51] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:09:20.463281 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-5647fedb-bcbb-4665-b6c0-dcca54b93fe8 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:09:20.463834 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-5647fedb-bcbb-4665-b6c0-dcca54b93fe8 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:09:20.464620 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-5647fedb-bcbb-4665-b6c0-dcca54b93fe8 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:09:20.465056 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-5647fedb-bcbb-4665-b6c0-dcca54b93fe8 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:09:20.531159 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-5647fedb-bcbb-4665-b6c0-dcca54b93fe8 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:09:20.539162 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-5647fedb-bcbb-4665-b6c0-dcca54b93fe8 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:09:20.540723 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-5647fedb-bcbb-4665-b6c0-dcca54b93fe8 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:09:20.541854 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-5647fedb-bcbb-4665-b6c0-dcca54b93fe8 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] 10.222.0.20 "GET /compute/v2.1/servers/5f84252c-dfc7-4c95-a315-5ac40d997d51" status: 200 len: 1284 microversion: 2.20 time: 0.089991 Jul 01 04:09:20.542416 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 262/534] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Jul 1 04:09:20 2022] GET /compute/v2.1/servers/5f84252c-dfc7-4c95-a315-5ac40d997d51 => generated 1284 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 04:09:21.561947 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-5f5cdf83-e5c3-4350-977a-6dede2043b94 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:09:21.562678 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-5f5cdf83-e5c3-4350-977a-6dede2043b94 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] [instance: 5f84252c-dfc7-4c95-a315-5ac40d997d51] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:09:21.571098 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-5f5cdf83-e5c3-4350-977a-6dede2043b94 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:09:21.571587 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-5f5cdf83-e5c3-4350-977a-6dede2043b94 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:09:21.572368 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-5f5cdf83-e5c3-4350-977a-6dede2043b94 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:09:21.573009 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-5f5cdf83-e5c3-4350-977a-6dede2043b94 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:09:21.643295 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-5f5cdf83-e5c3-4350-977a-6dede2043b94 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:09:21.653567 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-5f5cdf83-e5c3-4350-977a-6dede2043b94 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:09:21.655210 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-5f5cdf83-e5c3-4350-977a-6dede2043b94 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:09:21.656550 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-5f5cdf83-e5c3-4350-977a-6dede2043b94 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] 10.222.0.20 "GET /compute/v2.1/servers/5f84252c-dfc7-4c95-a315-5ac40d997d51" status: 200 len: 1332 microversion: 2.20 time: 0.098887 Jul 01 04:09:21.657947 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 273/535] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Jul 1 04:09:21 2022] GET /compute/v2.1/servers/5f84252c-dfc7-4c95-a315-5ac40d997d51 => generated 1332 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 04:09:22.676443 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-a25d70ec-f1e6-41d4-a034-f440ef0b6828 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:09:22.676831 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-a25d70ec-f1e6-41d4-a034-f440ef0b6828 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] [instance: 5f84252c-dfc7-4c95-a315-5ac40d997d51] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:09:22.684445 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-a25d70ec-f1e6-41d4-a034-f440ef0b6828 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:09:22.684894 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-a25d70ec-f1e6-41d4-a034-f440ef0b6828 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:09:22.685671 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-a25d70ec-f1e6-41d4-a034-f440ef0b6828 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:09:22.686108 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-a25d70ec-f1e6-41d4-a034-f440ef0b6828 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:09:22.843651 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-a25d70ec-f1e6-41d4-a034-f440ef0b6828 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:09:22.848299 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-a25d70ec-f1e6-41d4-a034-f440ef0b6828 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:09:22.850268 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-a25d70ec-f1e6-41d4-a034-f440ef0b6828 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:09:22.851768 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-a25d70ec-f1e6-41d4-a034-f440ef0b6828 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] 10.222.0.20 "GET /compute/v2.1/servers/5f84252c-dfc7-4c95-a315-5ac40d997d51" status: 200 len: 1406 microversion: 2.20 time: 0.180103 Jul 01 04:09:22.852326 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 263/536] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Jul 1 04:09:22 2022] GET /compute/v2.1/servers/5f84252c-dfc7-4c95-a315-5ac40d997d51 => generated 1406 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 04:09:23.719096 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [req-572dae32-9a07-4734-ac31-b8b7bd80f0ef req-52171af4-fde9-43af-baf7-837bd51b1dce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5f84252c-dfc7-4c95-a315-5ac40d997d51", "tag": "095204ce-045c-45fd-9ec9-e92cab097c71"}]} {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 04:09:23.729239 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [req-572dae32-9a07-4734-ac31-b8b7bd80f0ef req-52171af4-fde9-43af-baf7-837bd51b1dce service nova] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:09:23.729699 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [req-572dae32-9a07-4734-ac31-b8b7bd80f0ef req-52171af4-fde9-43af-baf7-837bd51b1dce service nova] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:09:23.742785 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.compute.server_external_events [req-572dae32-9a07-4734-ac31-b8b7bd80f0ef req-52171af4-fde9-43af-baf7-837bd51b1dce service nova] Creating event network-changed:095204ce-045c-45fd-9ec9-e92cab097c71 for instance 5f84252c-dfc7-4c95-a315-5ac40d997d51 on hv-cinder-84684 Jul 01 04:09:23.747783 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [req-572dae32-9a07-4734-ac31-b8b7bd80f0ef req-52171af4-fde9-43af-baf7-837bd51b1dce service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033746 Jul 01 04:09:23.748390 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 274/537] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Jul 1 04:09:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 04:09:23.870174 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-065bacfb-8216-498d-84ae-e9e899073442 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:09:23.872011 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-065bacfb-8216-498d-84ae-e9e899073442 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] [instance: 5f84252c-dfc7-4c95-a315-5ac40d997d51] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:09:23.879993 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-065bacfb-8216-498d-84ae-e9e899073442 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:09:23.881085 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-065bacfb-8216-498d-84ae-e9e899073442 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:09:23.882178 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-065bacfb-8216-498d-84ae-e9e899073442 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:09:23.882352 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-065bacfb-8216-498d-84ae-e9e899073442 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:09:24.019321 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-065bacfb-8216-498d-84ae-e9e899073442 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:09:24.028244 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-065bacfb-8216-498d-84ae-e9e899073442 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:09:24.029808 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-065bacfb-8216-498d-84ae-e9e899073442 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:09:24.030920 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-065bacfb-8216-498d-84ae-e9e899073442 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] 10.222.0.20 "GET /compute/v2.1/servers/5f84252c-dfc7-4c95-a315-5ac40d997d51" status: 200 len: 1406 microversion: 2.20 time: 0.164917 Jul 01 04:09:24.031566 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 264/538] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Jul 1 04:09:23 2022] GET /compute/v2.1/servers/5f84252c-dfc7-4c95-a315-5ac40d997d51 => generated 1406 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 04:09:25.055463 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-2f02b3cd-586d-42e7-ae08-2d7c13d5d1c1 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:09:25.056073 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-2f02b3cd-586d-42e7-ae08-2d7c13d5d1c1 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] [instance: 5f84252c-dfc7-4c95-a315-5ac40d997d51] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:09:25.062539 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-2f02b3cd-586d-42e7-ae08-2d7c13d5d1c1 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:09:25.062992 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-2f02b3cd-586d-42e7-ae08-2d7c13d5d1c1 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:09:25.063792 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-2f02b3cd-586d-42e7-ae08-2d7c13d5d1c1 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:09:25.064236 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-2f02b3cd-586d-42e7-ae08-2d7c13d5d1c1 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:09:25.205059 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-2f02b3cd-586d-42e7-ae08-2d7c13d5d1c1 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:09:25.212968 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-2f02b3cd-586d-42e7-ae08-2d7c13d5d1c1 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:09:25.214631 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-2f02b3cd-586d-42e7-ae08-2d7c13d5d1c1 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:09:25.216381 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-2f02b3cd-586d-42e7-ae08-2d7c13d5d1c1 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] 10.222.0.20 "GET /compute/v2.1/servers/5f84252c-dfc7-4c95-a315-5ac40d997d51" status: 200 len: 1406 microversion: 2.20 time: 0.165931 Jul 01 04:09:25.216954 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 275/539] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Jul 1 04:09:25 2022] GET /compute/v2.1/servers/5f84252c-dfc7-4c95-a315-5ac40d997d51 => generated 1406 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 04:09:26.237032 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-ee342188-fa65-4ab6-a7d3-4d9dd8584746 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:09:26.237694 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-ee342188-fa65-4ab6-a7d3-4d9dd8584746 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] [instance: 5f84252c-dfc7-4c95-a315-5ac40d997d51] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:09:26.244494 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-ee342188-fa65-4ab6-a7d3-4d9dd8584746 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:09:26.244953 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-ee342188-fa65-4ab6-a7d3-4d9dd8584746 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:09:26.245727 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-ee342188-fa65-4ab6-a7d3-4d9dd8584746 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:09:26.246166 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-ee342188-fa65-4ab6-a7d3-4d9dd8584746 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:09:26.386987 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-ee342188-fa65-4ab6-a7d3-4d9dd8584746 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:09:26.394895 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-ee342188-fa65-4ab6-a7d3-4d9dd8584746 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:09:26.396438 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-ee342188-fa65-4ab6-a7d3-4d9dd8584746 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:09:26.397530 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-ee342188-fa65-4ab6-a7d3-4d9dd8584746 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] 10.222.0.20 "GET /compute/v2.1/servers/5f84252c-dfc7-4c95-a315-5ac40d997d51" status: 200 len: 1406 microversion: 2.20 time: 0.165154 Jul 01 04:09:26.398095 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 265/540] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Jul 1 04:09:26 2022] GET /compute/v2.1/servers/5f84252c-dfc7-4c95-a315-5ac40d997d51 => generated 1406 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 04:09:27.416064 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-03c65af6-354b-4560-9c4f-8e54fcce9948 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:09:27.416688 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-03c65af6-354b-4560-9c4f-8e54fcce9948 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] [instance: 5f84252c-dfc7-4c95-a315-5ac40d997d51] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:09:27.424238 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-03c65af6-354b-4560-9c4f-8e54fcce9948 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:09:27.424727 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-03c65af6-354b-4560-9c4f-8e54fcce9948 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:09:27.425518 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-03c65af6-354b-4560-9c4f-8e54fcce9948 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:09:27.425966 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-03c65af6-354b-4560-9c4f-8e54fcce9948 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:09:27.568075 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-03c65af6-354b-4560-9c4f-8e54fcce9948 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:09:27.577120 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-03c65af6-354b-4560-9c4f-8e54fcce9948 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:09:27.578632 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-03c65af6-354b-4560-9c4f-8e54fcce9948 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:09:27.579818 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-03c65af6-354b-4560-9c4f-8e54fcce9948 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] 10.222.0.20 "GET /compute/v2.1/servers/5f84252c-dfc7-4c95-a315-5ac40d997d51" status: 200 len: 1406 microversion: 2.20 time: 0.167740 Jul 01 04:09:27.580388 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 276/541] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Jul 1 04:09:27 2022] GET /compute/v2.1/servers/5f84252c-dfc7-4c95-a315-5ac40d997d51 => generated 1406 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 04:09:28.598981 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-dc84573c-a629-4627-93d0-75999be69ed3 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:09:28.599636 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-dc84573c-a629-4627-93d0-75999be69ed3 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] [instance: 5f84252c-dfc7-4c95-a315-5ac40d997d51] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:09:28.607254 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-dc84573c-a629-4627-93d0-75999be69ed3 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:09:28.607706 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-dc84573c-a629-4627-93d0-75999be69ed3 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:09:28.608486 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-dc84573c-a629-4627-93d0-75999be69ed3 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:09:28.608929 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-dc84573c-a629-4627-93d0-75999be69ed3 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:09:28.907560 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-dc84573c-a629-4627-93d0-75999be69ed3 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:09:28.915613 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-dc84573c-a629-4627-93d0-75999be69ed3 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:09:28.917133 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-dc84573c-a629-4627-93d0-75999be69ed3 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:09:28.918234 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-dc84573c-a629-4627-93d0-75999be69ed3 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] 10.222.0.20 "GET /compute/v2.1/servers/5f84252c-dfc7-4c95-a315-5ac40d997d51" status: 200 len: 1406 microversion: 2.20 time: 0.323180 Jul 01 04:09:28.918790 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 266/542] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Jul 1 04:09:28 2022] GET /compute/v2.1/servers/5f84252c-dfc7-4c95-a315-5ac40d997d51 => generated 1406 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 01 04:09:29.936486 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-b9300d47-90d1-42ff-92e7-67ced2bcb592 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:09:29.937094 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-b9300d47-90d1-42ff-92e7-67ced2bcb592 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] [instance: 5f84252c-dfc7-4c95-a315-5ac40d997d51] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:09:29.939535 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG dbcounter [-] [118712] Writing DB stats nova_cell0:SELECT=6 {{(pid=118712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:09:29.944570 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-b9300d47-90d1-42ff-92e7-67ced2bcb592 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:09:29.945025 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-b9300d47-90d1-42ff-92e7-67ced2bcb592 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:09:29.945783 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-b9300d47-90d1-42ff-92e7-67ced2bcb592 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:09:29.946217 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-b9300d47-90d1-42ff-92e7-67ced2bcb592 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:09:30.139580 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-b9300d47-90d1-42ff-92e7-67ced2bcb592 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:09:30.147609 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-b9300d47-90d1-42ff-92e7-67ced2bcb592 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:09:30.149135 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-b9300d47-90d1-42ff-92e7-67ced2bcb592 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:09:30.150244 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-b9300d47-90d1-42ff-92e7-67ced2bcb592 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] 10.222.0.20 "GET /compute/v2.1/servers/5f84252c-dfc7-4c95-a315-5ac40d997d51" status: 200 len: 1406 microversion: 2.20 time: 0.217758 Jul 01 04:09:30.150810 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 277/543] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Jul 1 04:09:29 2022] GET /compute/v2.1/servers/5f84252c-dfc7-4c95-a315-5ac40d997d51 => generated 1406 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 04:09:31.169624 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-b9d53aaa-d879-4975-afd8-9d8734b32e63 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:09:31.170244 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-b9d53aaa-d879-4975-afd8-9d8734b32e63 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] [instance: 5f84252c-dfc7-4c95-a315-5ac40d997d51] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:09:31.172074 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG dbcounter [-] [118711] Writing DB stats nova_cell0:SELECT=2 {{(pid=118711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:09:31.172833 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG dbcounter [-] [118711] Writing DB stats nova_cell0:SELECT=6 {{(pid=118711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:09:31.178211 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-b9d53aaa-d879-4975-afd8-9d8734b32e63 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:09:31.178665 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-b9d53aaa-d879-4975-afd8-9d8734b32e63 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:09:31.179478 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-b9d53aaa-d879-4975-afd8-9d8734b32e63 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:09:31.179959 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-b9d53aaa-d879-4975-afd8-9d8734b32e63 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:09:31.338190 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-b9d53aaa-d879-4975-afd8-9d8734b32e63 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:09:31.346282 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-b9d53aaa-d879-4975-afd8-9d8734b32e63 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:09:31.347804 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-b9d53aaa-d879-4975-afd8-9d8734b32e63 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:09:31.348899 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-b9d53aaa-d879-4975-afd8-9d8734b32e63 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] 10.222.0.20 "GET /compute/v2.1/servers/5f84252c-dfc7-4c95-a315-5ac40d997d51" status: 200 len: 1406 microversion: 2.20 time: 0.183904 Jul 01 04:09:31.349448 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 267/544] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Jul 1 04:09:31 2022] GET /compute/v2.1/servers/5f84252c-dfc7-4c95-a315-5ac40d997d51 => generated 1406 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 04:09:32.374642 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-c1c1b234-7df6-458c-b450-28836b8ce8d7 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:09:32.375312 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-c1c1b234-7df6-458c-b450-28836b8ce8d7 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] [instance: 5f84252c-dfc7-4c95-a315-5ac40d997d51] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:09:32.377666 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG dbcounter [-] [118712] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=1 {{(pid=118712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:09:32.382652 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-c1c1b234-7df6-458c-b450-28836b8ce8d7 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:09:32.384581 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-c1c1b234-7df6-458c-b450-28836b8ce8d7 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:09:32.384581 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-c1c1b234-7df6-458c-b450-28836b8ce8d7 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:09:32.384581 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-c1c1b234-7df6-458c-b450-28836b8ce8d7 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:09:32.525352 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-c1c1b234-7df6-458c-b450-28836b8ce8d7 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:09:32.534100 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-c1c1b234-7df6-458c-b450-28836b8ce8d7 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:09:32.535901 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-c1c1b234-7df6-458c-b450-28836b8ce8d7 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:09:32.537220 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-c1c1b234-7df6-458c-b450-28836b8ce8d7 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] 10.222.0.20 "GET /compute/v2.1/servers/5f84252c-dfc7-4c95-a315-5ac40d997d51" status: 200 len: 1406 microversion: 2.20 time: 0.166628 Jul 01 04:09:32.537854 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 278/545] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Jul 1 04:09:32 2022] GET /compute/v2.1/servers/5f84252c-dfc7-4c95-a315-5ac40d997d51 => generated 1406 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 04:09:33.555921 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-44d544e8-11a5-4b11-b640-e79148882061 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:09:33.557053 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-44d544e8-11a5-4b11-b640-e79148882061 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] [instance: 5f84252c-dfc7-4c95-a315-5ac40d997d51] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:09:33.558989 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG dbcounter [-] [118711] Writing DB stats nova_api:SELECT=83,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=118711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:09:33.564430 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-44d544e8-11a5-4b11-b640-e79148882061 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:09:33.565127 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-44d544e8-11a5-4b11-b640-e79148882061 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:09:33.565922 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-44d544e8-11a5-4b11-b640-e79148882061 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:09:33.566356 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-44d544e8-11a5-4b11-b640-e79148882061 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:09:33.713943 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-44d544e8-11a5-4b11-b640-e79148882061 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:09:33.724641 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-44d544e8-11a5-4b11-b640-e79148882061 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:09:33.726255 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-44d544e8-11a5-4b11-b640-e79148882061 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:09:33.727461 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-44d544e8-11a5-4b11-b640-e79148882061 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] 10.222.0.20 "GET /compute/v2.1/servers/5f84252c-dfc7-4c95-a315-5ac40d997d51" status: 200 len: 1406 microversion: 2.20 time: 0.175402 Jul 01 04:09:33.728014 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 268/546] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Jul 1 04:09:33 2022] GET /compute/v2.1/servers/5f84252c-dfc7-4c95-a315-5ac40d997d51 => generated 1406 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 01 04:09:33.915085 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [req-058ae411-2869-42c4-99ef-0ce72c1a9f0e req-132429a9-8909-4f8b-b078-e2b8032b09f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f84252c-dfc7-4c95-a315-5ac40d997d51", "name": "network-vif-plugged", "status": "completed", "tag": "095204ce-045c-45fd-9ec9-e92cab097c71"}]} {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 04:09:33.925153 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [req-058ae411-2869-42c4-99ef-0ce72c1a9f0e req-132429a9-8909-4f8b-b078-e2b8032b09f3 service nova] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:09:33.925597 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [req-058ae411-2869-42c4-99ef-0ce72c1a9f0e req-132429a9-8909-4f8b-b078-e2b8032b09f3 service nova] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:09:33.929401 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG dbcounter [-] [118712] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:09:33.937432 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.compute.server_external_events [req-058ae411-2869-42c4-99ef-0ce72c1a9f0e req-132429a9-8909-4f8b-b078-e2b8032b09f3 service nova] Creating event network-vif-plugged:095204ce-045c-45fd-9ec9-e92cab097c71 for instance 5f84252c-dfc7-4c95-a315-5ac40d997d51 on hv-cinder-84684 Jul 01 04:09:33.942651 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [req-058ae411-2869-42c4-99ef-0ce72c1a9f0e req-132429a9-8909-4f8b-b078-e2b8032b09f3 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032146 Jul 01 04:09:33.943540 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 279/547] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Jul 1 04:09:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 04:09:34.746307 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-06f0ee0f-1c47-4abc-bf4d-0e41542d8cf7 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:09:34.746919 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-06f0ee0f-1c47-4abc-bf4d-0e41542d8cf7 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] [instance: 5f84252c-dfc7-4c95-a315-5ac40d997d51] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:09:34.753985 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-06f0ee0f-1c47-4abc-bf4d-0e41542d8cf7 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:09:34.754446 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-06f0ee0f-1c47-4abc-bf4d-0e41542d8cf7 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:09:34.755253 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-06f0ee0f-1c47-4abc-bf4d-0e41542d8cf7 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:09:34.755693 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-06f0ee0f-1c47-4abc-bf4d-0e41542d8cf7 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:09:34.890782 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-06f0ee0f-1c47-4abc-bf4d-0e41542d8cf7 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:09:34.898585 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-06f0ee0f-1c47-4abc-bf4d-0e41542d8cf7 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:09:34.900107 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-06f0ee0f-1c47-4abc-bf4d-0e41542d8cf7 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:09:34.901190 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-06f0ee0f-1c47-4abc-bf4d-0e41542d8cf7 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] 10.222.0.20 "GET /compute/v2.1/servers/5f84252c-dfc7-4c95-a315-5ac40d997d51" status: 200 len: 1406 microversion: 2.20 time: 0.159184 Jul 01 04:09:34.901734 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 269/548] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Jul 1 04:09:34 2022] GET /compute/v2.1/servers/5f84252c-dfc7-4c95-a315-5ac40d997d51 => generated 1406 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 04:09:35.920478 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-35e4b466-10b5-4f21-b5a8-fcc4b15ed137 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:09:35.921581 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-35e4b466-10b5-4f21-b5a8-fcc4b15ed137 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] [instance: 5f84252c-dfc7-4c95-a315-5ac40d997d51] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:09:35.932738 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-35e4b466-10b5-4f21-b5a8-fcc4b15ed137 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:09:35.933598 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-35e4b466-10b5-4f21-b5a8-fcc4b15ed137 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:09:35.935734 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-35e4b466-10b5-4f21-b5a8-fcc4b15ed137 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:09:35.936543 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-35e4b466-10b5-4f21-b5a8-fcc4b15ed137 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:09:36.097696 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-35e4b466-10b5-4f21-b5a8-fcc4b15ed137 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:09:36.105576 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-35e4b466-10b5-4f21-b5a8-fcc4b15ed137 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:09:36.107619 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-35e4b466-10b5-4f21-b5a8-fcc4b15ed137 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:09:36.108753 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-35e4b466-10b5-4f21-b5a8-fcc4b15ed137 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] 10.222.0.20 "GET /compute/v2.1/servers/5f84252c-dfc7-4c95-a315-5ac40d997d51" status: 200 len: 1406 microversion: 2.20 time: 0.194330 Jul 01 04:09:36.109311 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 280/549] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Jul 1 04:09:35 2022] GET /compute/v2.1/servers/5f84252c-dfc7-4c95-a315-5ac40d997d51 => generated 1406 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 04:09:37.128172 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-b3e943f9-f3a2-4496-acb3-ec2787a38ba2 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:09:37.128791 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-b3e943f9-f3a2-4496-acb3-ec2787a38ba2 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] [instance: 5f84252c-dfc7-4c95-a315-5ac40d997d51] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:09:37.135507 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-b3e943f9-f3a2-4496-acb3-ec2787a38ba2 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:09:37.135961 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-b3e943f9-f3a2-4496-acb3-ec2787a38ba2 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:09:37.136738 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-b3e943f9-f3a2-4496-acb3-ec2787a38ba2 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:09:37.137178 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-b3e943f9-f3a2-4496-acb3-ec2787a38ba2 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:09:37.273385 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-b3e943f9-f3a2-4496-acb3-ec2787a38ba2 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:09:37.281949 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-b3e943f9-f3a2-4496-acb3-ec2787a38ba2 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:09:37.284531 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-b3e943f9-f3a2-4496-acb3-ec2787a38ba2 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:09:37.284531 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-b3e943f9-f3a2-4496-acb3-ec2787a38ba2 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] 10.222.0.20 "GET /compute/v2.1/servers/5f84252c-dfc7-4c95-a315-5ac40d997d51" status: 200 len: 1406 microversion: 2.20 time: 0.160573 Jul 01 04:09:37.285149 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 270/550] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Jul 1 04:09:37 2022] GET /compute/v2.1/servers/5f84252c-dfc7-4c95-a315-5ac40d997d51 => generated 1406 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 04:09:38.302164 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-35e8280e-9540-428b-bab9-9d760b54b614 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:09:38.302789 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-35e8280e-9540-428b-bab9-9d760b54b614 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] [instance: 5f84252c-dfc7-4c95-a315-5ac40d997d51] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:09:38.310734 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-35e8280e-9540-428b-bab9-9d760b54b614 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:09:38.311193 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-35e8280e-9540-428b-bab9-9d760b54b614 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:09:38.312154 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-35e8280e-9540-428b-bab9-9d760b54b614 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:09:38.312599 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-35e8280e-9540-428b-bab9-9d760b54b614 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:09:38.456157 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-35e8280e-9540-428b-bab9-9d760b54b614 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:09:38.465051 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-35e8280e-9540-428b-bab9-9d760b54b614 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:09:38.467122 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-35e8280e-9540-428b-bab9-9d760b54b614 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:09:38.468332 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-35e8280e-9540-428b-bab9-9d760b54b614 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] 10.222.0.20 "GET /compute/v2.1/servers/5f84252c-dfc7-4c95-a315-5ac40d997d51" status: 200 len: 1406 microversion: 2.20 time: 0.170317 Jul 01 04:09:38.468914 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 281/551] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Jul 1 04:09:38 2022] GET /compute/v2.1/servers/5f84252c-dfc7-4c95-a315-5ac40d997d51 => generated 1406 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 04:09:39.496778 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-05ac5785-ac81-4c14-86fb-9b3025af92ec tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:09:39.497345 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-05ac5785-ac81-4c14-86fb-9b3025af92ec tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] [instance: 5f84252c-dfc7-4c95-a315-5ac40d997d51] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:09:39.504408 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-05ac5785-ac81-4c14-86fb-9b3025af92ec tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:09:39.504864 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-05ac5785-ac81-4c14-86fb-9b3025af92ec tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:09:39.505658 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-05ac5785-ac81-4c14-86fb-9b3025af92ec tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:09:39.506100 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-05ac5785-ac81-4c14-86fb-9b3025af92ec tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:09:39.691840 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-05ac5785-ac81-4c14-86fb-9b3025af92ec tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:09:39.701405 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-05ac5785-ac81-4c14-86fb-9b3025af92ec tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:09:39.703009 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-05ac5785-ac81-4c14-86fb-9b3025af92ec tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:09:39.704273 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-05ac5785-ac81-4c14-86fb-9b3025af92ec tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] 10.222.0.20 "GET /compute/v2.1/servers/5f84252c-dfc7-4c95-a315-5ac40d997d51" status: 200 len: 1597 microversion: 2.20 time: 0.211816 Jul 01 04:09:39.704881 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 271/552] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Jul 1 04:09:39 2022] GET /compute/v2.1/servers/5f84252c-dfc7-4c95-a315-5ac40d997d51 => generated 1597 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 04:09:39.724731 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-1d8f3e6a-6db6-47db-8a4d-0c839df898a7 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:09:39.724731 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-1d8f3e6a-6db6-47db-8a4d-0c839df898a7 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] [instance: 5f84252c-dfc7-4c95-a315-5ac40d997d51] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:09:39.729309 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-1d8f3e6a-6db6-47db-8a4d-0c839df898a7 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:09:39.729754 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-1d8f3e6a-6db6-47db-8a4d-0c839df898a7 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:09:39.730525 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-1d8f3e6a-6db6-47db-8a4d-0c839df898a7 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:09:39.730958 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-1d8f3e6a-6db6-47db-8a4d-0c839df898a7 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:09:39.813906 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-1d8f3e6a-6db6-47db-8a4d-0c839df898a7 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] 10.222.0.20 "GET /compute/v2.1/servers/5f84252c-dfc7-4c95-a315-5ac40d997d51/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.095750 Jul 01 04:09:39.814598 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 282/553] 10.222.0.20 () {60 vars in 1315 bytes} [Fri Jul 1 04:09:39 2022] GET /compute/v2.1/servers/5f84252c-dfc7-4c95-a315-5ac40d997d51/os-interface => generated 284 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 01 04:09:40.374574 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-f7a6851b-27ee-442e-b8b8-cd626f604a23 tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:09:40.375073 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-f7a6851b-27ee-442e-b8b8-cd626f604a23 tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] [instance: fa6a7a92-a9c5-41a4-b8d4-356787a243bc] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:09:40.381464 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-f7a6851b-27ee-442e-b8b8-cd626f604a23 tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:09:40.381917 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-f7a6851b-27ee-442e-b8b8-cd626f604a23 tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:09:40.382703 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-f7a6851b-27ee-442e-b8b8-cd626f604a23 tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:09:40.383143 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-f7a6851b-27ee-442e-b8b8-cd626f604a23 tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:09:40.470349 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.objects.instance [None req-f7a6851b-27ee-442e-b8b8-cd626f604a23 tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Lazy-loading 'services' on Instance uuid fa6a7a92-a9c5-41a4-b8d4-356787a243bc {{(pid=118711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 04:09:40.758999 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-f7a6851b-27ee-442e-b8b8-cd626f604a23 tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] 10.222.0.20 "DELETE /compute/v2.1/servers/fa6a7a92-a9c5-41a4-b8d4-356787a243bc/os-volume_attachments/d983a283-d95a-4906-99a0-e3ce9ac0eacc" status: 202 len: 0 microversion: 2.1 time: 0.387955 Jul 01 04:09:40.759732 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 272/554] 10.222.0.20 () {58 vars in 1415 bytes} [Fri Jul 1 04:09:40 2022] DELETE /compute/v2.1/servers/fa6a7a92-a9c5-41a4-b8d4-356787a243bc/os-volume_attachments/d983a283-d95a-4906-99a0-e3ce9ac0eacc => generated 0 bytes in 390 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 04:09:41.225018 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [req-b8a3d3d3-f5de-4c0b-b27a-b8353f0809c5 req-d869acef-77ec-46df-8de3-47f466ab549b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5f84252c-dfc7-4c95-a315-5ac40d997d51", "tag": "095204ce-045c-45fd-9ec9-e92cab097c71"}]} {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 04:09:41.233677 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [req-b8a3d3d3-f5de-4c0b-b27a-b8353f0809c5 req-d869acef-77ec-46df-8de3-47f466ab549b service nova] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:09:41.234122 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [req-b8a3d3d3-f5de-4c0b-b27a-b8353f0809c5 req-d869acef-77ec-46df-8de3-47f466ab549b service nova] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:09:41.246639 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.compute.server_external_events [req-b8a3d3d3-f5de-4c0b-b27a-b8353f0809c5 req-d869acef-77ec-46df-8de3-47f466ab549b service nova] Creating event network-changed:095204ce-045c-45fd-9ec9-e92cab097c71 for instance 5f84252c-dfc7-4c95-a315-5ac40d997d51 on hv-cinder-84684 Jul 01 04:09:41.255573 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [req-b8a3d3d3-f5de-4c0b-b27a-b8353f0809c5 req-d869acef-77ec-46df-8de3-47f466ab549b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031503 Jul 01 04:09:41.255573 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 283/555] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Jul 1 04:09:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 04:09:42.967450 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-ae07c2c5-134b-4e8f-811f-b5e9bb8a4259 tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:09:42.968564 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-ae07c2c5-134b-4e8f-811f-b5e9bb8a4259 tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] [instance: fa6a7a92-a9c5-41a4-b8d4-356787a243bc] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:09:42.978109 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-ae07c2c5-134b-4e8f-811f-b5e9bb8a4259 tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:09:42.978644 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-ae07c2c5-134b-4e8f-811f-b5e9bb8a4259 tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:09:42.979463 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-ae07c2c5-134b-4e8f-811f-b5e9bb8a4259 tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:09:42.979907 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-ae07c2c5-134b-4e8f-811f-b5e9bb8a4259 tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:09:43.006373 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-ae07c2c5-134b-4e8f-811f-b5e9bb8a4259 tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] [instance: fa6a7a92-a9c5-41a4-b8d4-356787a243bc] Going to try to terminate instance {{(pid=118711) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 01 04:09:43.009420 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG dbcounter [-] [118711] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=118711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:09:43.319515 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-ae07c2c5-134b-4e8f-811f-b5e9bb8a4259 tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] 10.222.0.20 "DELETE /compute/v2.1/servers/fa6a7a92-a9c5-41a4-b8d4-356787a243bc" status: 204 len: 0 microversion: 2.1 time: 0.358762 Jul 01 04:09:43.320156 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 273/556] 10.222.0.20 () {58 vars in 1238 bytes} [Fri Jul 1 04:09:42 2022] DELETE /compute/v2.1/servers/fa6a7a92-a9c5-41a4-b8d4-356787a243bc => generated 0 bytes in 361 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 01 04:09:43.329997 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-1ca1b946-f682-471a-884b-1fe88de2761f tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:09:43.330717 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-1ca1b946-f682-471a-884b-1fe88de2761f tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] [instance: fa6a7a92-a9c5-41a4-b8d4-356787a243bc] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:09:43.339109 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-1ca1b946-f682-471a-884b-1fe88de2761f tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:09:43.344108 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-1ca1b946-f682-471a-884b-1fe88de2761f tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:09:43.344108 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-1ca1b946-f682-471a-884b-1fe88de2761f tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:09:43.344108 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-1ca1b946-f682-471a-884b-1fe88de2761f tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:09:43.486151 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-1ca1b946-f682-471a-884b-1fe88de2761f tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021817b0eef94fc2a19d90c511ec9298', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87ca5d9f50847d6ab501ca3a51ab37c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:09:43.494120 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-1ca1b946-f682-471a-884b-1fe88de2761f tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] 10.222.0.20 "GET /compute/v2.1/servers/fa6a7a92-a9c5-41a4-b8d4-356787a243bc" status: 200 len: 1513 microversion: 2.1 time: 0.168970 Jul 01 04:09:43.494706 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 284/557] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:09:43 2022] GET /compute/v2.1/servers/fa6a7a92-a9c5-41a4-b8d4-356787a243bc => generated 1513 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:09:44.512789 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-4c25fc92-9393-4500-a3f2-2dbbcc85ff9d tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:09:44.513491 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-4c25fc92-9393-4500-a3f2-2dbbcc85ff9d tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] [instance: fa6a7a92-a9c5-41a4-b8d4-356787a243bc] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:09:44.522043 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-4c25fc92-9393-4500-a3f2-2dbbcc85ff9d tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:09:44.522612 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-4c25fc92-9393-4500-a3f2-2dbbcc85ff9d tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:09:44.523431 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-4c25fc92-9393-4500-a3f2-2dbbcc85ff9d tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:09:44.523861 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-4c25fc92-9393-4500-a3f2-2dbbcc85ff9d tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:09:44.669703 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-4c25fc92-9393-4500-a3f2-2dbbcc85ff9d tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021817b0eef94fc2a19d90c511ec9298', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87ca5d9f50847d6ab501ca3a51ab37c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:09:44.677959 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-4c25fc92-9393-4500-a3f2-2dbbcc85ff9d tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] 10.222.0.20 "GET /compute/v2.1/servers/fa6a7a92-a9c5-41a4-b8d4-356787a243bc" status: 200 len: 1513 microversion: 2.1 time: 0.169434 Jul 01 04:09:44.678538 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 274/558] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:09:44 2022] GET /compute/v2.1/servers/fa6a7a92-a9c5-41a4-b8d4-356787a243bc => generated 1513 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:09:45.695492 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-219321a5-7e97-4f7f-8cdb-7795f6364493 tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:09:45.696098 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-219321a5-7e97-4f7f-8cdb-7795f6364493 tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] [instance: fa6a7a92-a9c5-41a4-b8d4-356787a243bc] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:09:45.702812 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-219321a5-7e97-4f7f-8cdb-7795f6364493 tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:09:45.703290 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-219321a5-7e97-4f7f-8cdb-7795f6364493 tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:09:45.704067 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-219321a5-7e97-4f7f-8cdb-7795f6364493 tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:09:45.704504 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-219321a5-7e97-4f7f-8cdb-7795f6364493 tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:09:45.834104 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-219321a5-7e97-4f7f-8cdb-7795f6364493 tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021817b0eef94fc2a19d90c511ec9298', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87ca5d9f50847d6ab501ca3a51ab37c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:09:45.841762 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-219321a5-7e97-4f7f-8cdb-7795f6364493 tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] 10.222.0.20 "GET /compute/v2.1/servers/fa6a7a92-a9c5-41a4-b8d4-356787a243bc" status: 200 len: 1513 microversion: 2.1 time: 0.150174 Jul 01 04:09:45.842415 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 285/559] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:09:45 2022] GET /compute/v2.1/servers/fa6a7a92-a9c5-41a4-b8d4-356787a243bc => generated 1513 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:09:46.857996 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-0cae1509-cdbe-495a-a0e9-5fc22166bba2 tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:09:46.858757 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-0cae1509-cdbe-495a-a0e9-5fc22166bba2 tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] [instance: fa6a7a92-a9c5-41a4-b8d4-356787a243bc] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:09:46.865264 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-0cae1509-cdbe-495a-a0e9-5fc22166bba2 tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:09:46.865707 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-0cae1509-cdbe-495a-a0e9-5fc22166bba2 tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:09:46.866469 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-0cae1509-cdbe-495a-a0e9-5fc22166bba2 tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:09:46.866900 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-0cae1509-cdbe-495a-a0e9-5fc22166bba2 tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:09:47.006157 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-0cae1509-cdbe-495a-a0e9-5fc22166bba2 tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021817b0eef94fc2a19d90c511ec9298', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87ca5d9f50847d6ab501ca3a51ab37c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:09:47.014508 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-0cae1509-cdbe-495a-a0e9-5fc22166bba2 tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] 10.222.0.20 "GET /compute/v2.1/servers/fa6a7a92-a9c5-41a4-b8d4-356787a243bc" status: 200 len: 1513 microversion: 2.1 time: 0.159825 Jul 01 04:09:47.024282 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 275/560] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:09:46 2022] GET /compute/v2.1/servers/fa6a7a92-a9c5-41a4-b8d4-356787a243bc => generated 1513 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:09:47.277909 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 01 04:09:47.278491 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: Fri Jul 1 04:09:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 01 04:09:47.336784 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [req-68235f63-f1d2-482e-bb13-f1058d857f5a req-e2698c0b-03a0-4e6f-8079-a367d32dfd0d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa6a7a92-a9c5-41a4-b8d4-356787a243bc", "name": "network-vif-deleted", "tag": "0312ab03-cc44-4db7-ba4a-0ac3db603bcb"}]} {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 04:09:47.345527 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [req-68235f63-f1d2-482e-bb13-f1058d857f5a req-e2698c0b-03a0-4e6f-8079-a367d32dfd0d service nova] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:09:47.349572 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [req-68235f63-f1d2-482e-bb13-f1058d857f5a req-e2698c0b-03a0-4e6f-8079-a367d32dfd0d service nova] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:09:47.356241 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.compute.server_external_events [req-68235f63-f1d2-482e-bb13-f1058d857f5a req-e2698c0b-03a0-4e6f-8079-a367d32dfd0d service nova] Creating event network-vif-deleted:0312ab03-cc44-4db7-ba4a-0ac3db603bcb for instance fa6a7a92-a9c5-41a4-b8d4-356787a243bc on hv-cinder-84684 Jul 01 04:09:47.361545 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [req-68235f63-f1d2-482e-bb13-f1058d857f5a req-e2698c0b-03a0-4e6f-8079-a367d32dfd0d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028866 Jul 01 04:09:47.362127 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 286/561] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Jul 1 04:09:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 04:09:48.032479 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-61f6270a-d04b-4dcc-b1b9-0e2f694f8a10 tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:09:48.033123 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-61f6270a-d04b-4dcc-b1b9-0e2f694f8a10 tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] [instance: fa6a7a92-a9c5-41a4-b8d4-356787a243bc] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:09:48.040221 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-61f6270a-d04b-4dcc-b1b9-0e2f694f8a10 tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:09:48.040678 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-61f6270a-d04b-4dcc-b1b9-0e2f694f8a10 tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:09:48.041464 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-61f6270a-d04b-4dcc-b1b9-0e2f694f8a10 tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:09:48.041905 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-61f6270a-d04b-4dcc-b1b9-0e2f694f8a10 tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:09:48.079364 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-61f6270a-d04b-4dcc-b1b9-0e2f694f8a10 tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:09:48.079806 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-61f6270a-d04b-4dcc-b1b9-0e2f694f8a10 tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:09:48.080274 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.objects.instance [None req-61f6270a-d04b-4dcc-b1b9-0e2f694f8a10 tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Lazy-loading 'fault' on Instance uuid fa6a7a92-a9c5-41a4-b8d4-356787a243bc {{(pid=118711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 04:09:48.135495 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-61f6270a-d04b-4dcc-b1b9-0e2f694f8a10 tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021817b0eef94fc2a19d90c511ec9298', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87ca5d9f50847d6ab501ca3a51ab37c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:09:48.144189 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-61f6270a-d04b-4dcc-b1b9-0e2f694f8a10 tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] 10.222.0.20 "GET /compute/v2.1/servers/fa6a7a92-a9c5-41a4-b8d4-356787a243bc" status: 200 len: 1309 microversion: 2.1 time: 0.116166 Jul 01 04:09:48.144885 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 276/562] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:09:48 2022] GET /compute/v2.1/servers/fa6a7a92-a9c5-41a4-b8d4-356787a243bc => generated 1309 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:09:49.163081 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-b6be6a59-0d83-4bc1-bbdf-0868c9abb7f6 tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:09:49.163826 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-b6be6a59-0d83-4bc1-bbdf-0868c9abb7f6 tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] [instance: fa6a7a92-a9c5-41a4-b8d4-356787a243bc] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:09:49.170689 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-b6be6a59-0d83-4bc1-bbdf-0868c9abb7f6 tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:09:49.171145 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-b6be6a59-0d83-4bc1-bbdf-0868c9abb7f6 tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:09:49.171955 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-b6be6a59-0d83-4bc1-bbdf-0868c9abb7f6 tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:09:49.172405 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-b6be6a59-0d83-4bc1-bbdf-0868c9abb7f6 tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:09:49.186162 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.wsgi [None req-b6be6a59-0d83-4bc1-bbdf-0868c9abb7f6 tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] HTTP exception thrown: Instance fa6a7a92-a9c5-41a4-b8d4-356787a243bc could not be found. Jul 01 04:09:49.187964 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-b6be6a59-0d83-4bc1-bbdf-0868c9abb7f6 tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Request method failure captured: Jul 01 04:09:49.187964 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: request: GET /compute/v2.1/servers/fa6a7a92-a9c5-41a4-b8d4-356787a243bc HTTP/1.1 Jul 01 04:09:49.187964 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: Accept: application/json Jul 01 04:09:49.187964 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: Accept-Encoding: identity Jul 01 04:09:49.187964 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: Connection: close Jul 01 04:09:49.187964 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: Content-Length: 0 Jul 01 04:09:49.187964 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: Content-Type: application/json Jul 01 04:09:49.187964 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: Host: 10.222.0.20 Jul 01 04:09:49.187964 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: Openstack-System-Scope: None Jul 01 04:09:49.187964 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: User-Agent: python-urllib3/1.26.9 Jul 01 04:09:49.187964 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Auth-Token: gAAAAABivnLg3JvkEP6c_-cbMGwLFF7GaPdZAi6_U98zlw0cn-k-JJhA0Ae4BmEHRgF2YQqevLpog3fS4AN0TxQ0_wy-BAX8T7vQtlaxpLtoXFEDJ9TCSsLqPDiFml_aNWrQjTDq7VSoYNdYi_N7wolC3KYyMrACv_5100qxhY89eNe32W4ke1w Jul 01 04:09:49.187964 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Domain-Id: None Jul 01 04:09:49.187964 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Domain-Name: None Jul 01 04:09:49.187964 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Identity-Status: Confirmed Jul 01 04:09:49.187964 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Is-Admin-Project: True Jul 01 04:09:49.187964 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Project-Domain-Id: default Jul 01 04:09:49.187964 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Project-Domain-Name: Default Jul 01 04:09:49.187964 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Project-Id: e87ca5d9f50847d6ab501ca3a51ab37c Jul 01 04:09:49.187964 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Project-Name: tempest-VolumesSnapshotTestJSON-350761947 Jul 01 04:09:49.187964 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Role: reader,member Jul 01 04:09:49.187964 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Roles: reader,member Jul 01 04:09:49.189948 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/e87ca5d9f50847d6ab501ca3a51ab37c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_e87ca5d9f50847d6ab501ca3a51ab37c", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e87ca5d9f50847d6ab501ca3a51ab37c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e87ca5d9f50847d6ab501ca3a51ab37c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}] Jul 01 04:09:49.189948 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Tenant: tempest-VolumesSnapshotTestJSON-350761947 Jul 01 04:09:49.189948 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Tenant-Id: e87ca5d9f50847d6ab501ca3a51ab37c Jul 01 04:09:49.189948 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-350761947 Jul 01 04:09:49.189948 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-User: tempest-VolumesSnapshotTestJSON-350761947-project Jul 01 04:09:49.189948 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-User-Domain-Id: default Jul 01 04:09:49.189948 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-User-Domain-Name: Default Jul 01 04:09:49.189948 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-User-Id: 021817b0eef94fc2a19d90c511ec9298 Jul 01 04:09:49.189948 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-User-Name: tempest-VolumesSnapshotTestJSON-350761947-project Jul 01 04:09:49.189948 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: method: > Jul 01 04:09:49.189948 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: exception: Instance fa6a7a92-a9c5-41a4-b8d4-356787a243bc could not be found. Jul 01 04:09:49.189948 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: action_args: {'id': 'fa6a7a92-a9c5-41a4-b8d4-356787a243bc'} Jul 01 04:09:49.191488 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 04:09:49.191488 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 04:09:49.191488 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 04:09:49.191488 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 04:09:49.191488 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 04:09:49.191488 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 04:09:49.191488 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 04:09:49.191488 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 04:09:49.191488 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 04:09:49.191488 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 04:09:49.191488 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fa6a7a92-a9c5-41a4-b8d4-356787a243bc could not be found. Jul 01 04:09:49.191488 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi Jul 01 04:09:49.191488 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 04:09:49.191488 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi Jul 01 04:09:49.191488 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 04:09:49.191488 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 04:09:49.191488 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 04:09:49.191488 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 04:09:49.191488 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 04:09:49.191488 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 04:09:49.193119 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 04:09:49.193119 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 04:09:49.193119 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 04:09:49.193119 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 04:09:49.193119 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 04:09:49.193119 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 04:09:49.193119 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 04:09:49.193119 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fa6a7a92-a9c5-41a4-b8d4-356787a243bc could not be found. Jul 01 04:09:49.193119 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi Jul 01 04:09:49.193119 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 04:09:49.193119 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi Jul 01 04:09:49.193119 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 04:09:49.193119 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 04:09:49.193119 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 04:09:49.193119 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 04:09:49.193119 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 04:09:49.193119 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fa6a7a92-a9c5-41a4-b8d4-356787a243bc could not be found. Jul 01 04:09:49.193119 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi Jul 01 04:09:49.194273 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-b6be6a59-0d83-4bc1-bbdf-0868c9abb7f6 tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] Returning 404 to user: Instance fa6a7a92-a9c5-41a4-b8d4-356787a243bc could not be found. {{(pid=118712) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 04:09:49.194273 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-b6be6a59-0d83-4bc1-bbdf-0868c9abb7f6 tempest-VolumesSnapshotTestJSON-350761947 tempest-VolumesSnapshotTestJSON-350761947-project] 10.222.0.20 "GET /compute/v2.1/servers/fa6a7a92-a9c5-41a4-b8d4-356787a243bc" status: 404 len: 111 microversion: 2.1 time: 0.030898 Jul 01 04:09:49.194273 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 287/563] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:09:49 2022] GET /compute/v2.1/servers/fa6a7a92-a9c5-41a4-b8d4-356787a243bc => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 04:09:54.267044 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-4356fde6-394a-427c-9a0c-d4639fbe28e8 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:09:54.267544 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-4356fde6-394a-427c-9a0c-d4639fbe28e8 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] [instance: 1f96263a-e229-447e-aa6b-dd9c2872c751] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:09:54.274259 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-4356fde6-394a-427c-9a0c-d4639fbe28e8 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:09:54.274708 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-4356fde6-394a-427c-9a0c-d4639fbe28e8 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:09:54.275614 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-4356fde6-394a-427c-9a0c-d4639fbe28e8 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:09:54.276047 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-4356fde6-394a-427c-9a0c-d4639fbe28e8 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:09:54.359571 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.objects.instance [None req-4356fde6-394a-427c-9a0c-d4639fbe28e8 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lazy-loading 'services' on Instance uuid 1f96263a-e229-447e-aa6b-dd9c2872c751 {{(pid=118711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 04:09:54.604577 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-4356fde6-394a-427c-9a0c-d4639fbe28e8 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] 10.222.0.20 "DELETE /compute/v2.1/servers/1f96263a-e229-447e-aa6b-dd9c2872c751/os-volume_attachments/1aa822c2-aab0-4145-97a3-0137fc264d4e" status: 202 len: 0 microversion: 2.1 time: 0.341680 Jul 01 04:09:54.605094 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 277/564] 10.222.0.20 () {58 vars in 1415 bytes} [Fri Jul 1 04:09:54 2022] DELETE /compute/v2.1/servers/1f96263a-e229-447e-aa6b-dd9c2872c751/os-volume_attachments/1aa822c2-aab0-4145-97a3-0137fc264d4e => generated 0 bytes in 343 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 04:09:54.614508 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-6f2d0154-4573-45b4-86d5-c79f9e0b2a9a tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:09:54.615485 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-6f2d0154-4573-45b4-86d5-c79f9e0b2a9a tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] [instance: 1f96263a-e229-447e-aa6b-dd9c2872c751] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:09:54.622528 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-6f2d0154-4573-45b4-86d5-c79f9e0b2a9a tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:09:54.622982 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-6f2d0154-4573-45b4-86d5-c79f9e0b2a9a tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:09:54.623825 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-6f2d0154-4573-45b4-86d5-c79f9e0b2a9a tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:09:54.624830 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-6f2d0154-4573-45b4-86d5-c79f9e0b2a9a tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:09:54.655694 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-6f2d0154-4573-45b4-86d5-c79f9e0b2a9a tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] 10.222.0.20 "GET /compute/v2.1/servers/1f96263a-e229-447e-aa6b-dd9c2872c751/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045274 Jul 01 04:09:54.656264 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 288/565] 10.222.0.20 () {58 vars in 1301 bytes} [Fri Jul 1 04:09:54 2022] GET /compute/v2.1/servers/1f96263a-e229-447e-aa6b-dd9c2872c751/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 04:09:55.668219 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-e004dfd4-64c8-4e16-90f2-118b3adeb432 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:09:55.669352 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-e004dfd4-64c8-4e16-90f2-118b3adeb432 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] [instance: 1f96263a-e229-447e-aa6b-dd9c2872c751] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:09:55.676017 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-e004dfd4-64c8-4e16-90f2-118b3adeb432 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:09:55.676347 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-e004dfd4-64c8-4e16-90f2-118b3adeb432 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:09:55.677204 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-e004dfd4-64c8-4e16-90f2-118b3adeb432 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:09:55.677641 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-e004dfd4-64c8-4e16-90f2-118b3adeb432 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:09:55.713538 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-e004dfd4-64c8-4e16-90f2-118b3adeb432 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] 10.222.0.20 "GET /compute/v2.1/servers/1f96263a-e229-447e-aa6b-dd9c2872c751/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047547 Jul 01 04:09:55.713538 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 278/566] 10.222.0.20 () {58 vars in 1301 bytes} [Fri Jul 1 04:09:55 2022] GET /compute/v2.1/servers/1f96263a-e229-447e-aa6b-dd9c2872c751/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 04:09:56.725202 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-a371b041-4b3a-4387-9997-307765572481 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:09:56.726149 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-a371b041-4b3a-4387-9997-307765572481 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] [instance: 1f96263a-e229-447e-aa6b-dd9c2872c751] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:09:56.734003 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-a371b041-4b3a-4387-9997-307765572481 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:09:56.734660 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-a371b041-4b3a-4387-9997-307765572481 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:09:56.735518 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-a371b041-4b3a-4387-9997-307765572481 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:09:56.735966 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-a371b041-4b3a-4387-9997-307765572481 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:09:56.766800 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-a371b041-4b3a-4387-9997-307765572481 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] 10.222.0.20 "GET /compute/v2.1/servers/1f96263a-e229-447e-aa6b-dd9c2872c751/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045735 Jul 01 04:09:56.767420 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 289/567] 10.222.0.20 () {58 vars in 1301 bytes} [Fri Jul 1 04:09:56 2022] GET /compute/v2.1/servers/1f96263a-e229-447e-aa6b-dd9c2872c751/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 04:09:57.778672 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-1f2adfad-56a3-40d1-bc24-5c3ef5a504f5 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:09:57.779634 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-1f2adfad-56a3-40d1-bc24-5c3ef5a504f5 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] [instance: 1f96263a-e229-447e-aa6b-dd9c2872c751] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:09:57.786281 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-1f2adfad-56a3-40d1-bc24-5c3ef5a504f5 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:09:57.786740 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-1f2adfad-56a3-40d1-bc24-5c3ef5a504f5 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:09:57.787702 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-1f2adfad-56a3-40d1-bc24-5c3ef5a504f5 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:09:57.788168 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-1f2adfad-56a3-40d1-bc24-5c3ef5a504f5 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:09:57.818493 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-1f2adfad-56a3-40d1-bc24-5c3ef5a504f5 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] 10.222.0.20 "GET /compute/v2.1/servers/1f96263a-e229-447e-aa6b-dd9c2872c751/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043731 Jul 01 04:09:57.819059 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 279/568] 10.222.0.20 () {58 vars in 1301 bytes} [Fri Jul 1 04:09:57 2022] GET /compute/v2.1/servers/1f96263a-e229-447e-aa6b-dd9c2872c751/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 04:09:58.830256 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-eb5a8ba6-cecb-49f1-826b-a78898d37639 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:09:58.831175 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-eb5a8ba6-cecb-49f1-826b-a78898d37639 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] [instance: 1f96263a-e229-447e-aa6b-dd9c2872c751] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:09:58.837755 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-eb5a8ba6-cecb-49f1-826b-a78898d37639 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:09:58.838209 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-eb5a8ba6-cecb-49f1-826b-a78898d37639 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:09:58.838977 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-eb5a8ba6-cecb-49f1-826b-a78898d37639 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:09:58.839472 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-eb5a8ba6-cecb-49f1-826b-a78898d37639 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:09:58.869325 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-eb5a8ba6-cecb-49f1-826b-a78898d37639 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] 10.222.0.20 "GET /compute/v2.1/servers/1f96263a-e229-447e-aa6b-dd9c2872c751/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043634 Jul 01 04:09:58.869912 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 290/569] 10.222.0.20 () {58 vars in 1301 bytes} [Fri Jul 1 04:09:58 2022] GET /compute/v2.1/servers/1f96263a-e229-447e-aa6b-dd9c2872c751/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 01 04:09:58.947619 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-4c5ac455-6da1-43f2-bded-060fe1930baf tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:09:58.948188 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-4c5ac455-6da1-43f2-bded-060fe1930baf tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] [instance: 1f96263a-e229-447e-aa6b-dd9c2872c751] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:09:58.955200 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-4c5ac455-6da1-43f2-bded-060fe1930baf tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:09:58.955614 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-4c5ac455-6da1-43f2-bded-060fe1930baf tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:09:58.956447 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-4c5ac455-6da1-43f2-bded-060fe1930baf tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:09:58.956880 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-4c5ac455-6da1-43f2-bded-060fe1930baf tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:09:58.983008 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-4c5ac455-6da1-43f2-bded-060fe1930baf tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] [instance: 1f96263a-e229-447e-aa6b-dd9c2872c751] Going to try to terminate instance {{(pid=118711) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 01 04:09:59.316228 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-4c5ac455-6da1-43f2-bded-060fe1930baf tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] 10.222.0.20 "DELETE /compute/v2.1/servers/1f96263a-e229-447e-aa6b-dd9c2872c751" status: 204 len: 0 microversion: 2.1 time: 0.371514 Jul 01 04:09:59.320460 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 280/570] 10.222.0.20 () {58 vars in 1238 bytes} [Fri Jul 1 04:09:58 2022] DELETE /compute/v2.1/servers/1f96263a-e229-447e-aa6b-dd9c2872c751 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 01 04:09:59.328023 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-138bf288-2f09-47a5-9a01-f25c6610c180 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:09:59.329052 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-138bf288-2f09-47a5-9a01-f25c6610c180 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] [instance: 1f96263a-e229-447e-aa6b-dd9c2872c751] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:09:59.336008 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-138bf288-2f09-47a5-9a01-f25c6610c180 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:09:59.336483 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-138bf288-2f09-47a5-9a01-f25c6610c180 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:09:59.337261 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-138bf288-2f09-47a5-9a01-f25c6610c180 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:09:59.337698 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-138bf288-2f09-47a5-9a01-f25c6610c180 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:09:59.501554 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-138bf288-2f09-47a5-9a01-f25c6610c180 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8622ec5212c84d87b9b7c8f725012a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0143140d4f649478e36abcee284640c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:09:59.509524 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-138bf288-2f09-47a5-9a01-f25c6610c180 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] 10.222.0.20 "GET /compute/v2.1/servers/1f96263a-e229-447e-aa6b-dd9c2872c751" status: 200 len: 1690 microversion: 2.1 time: 0.186644 Jul 01 04:09:59.510092 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 291/571] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:09:59 2022] GET /compute/v2.1/servers/1f96263a-e229-447e-aa6b-dd9c2872c751 => generated 1690 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:10:00.533513 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-d602a763-abdc-4969-a348-d5366ddc3126 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:10:00.534839 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-d602a763-abdc-4969-a348-d5366ddc3126 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] [instance: 1f96263a-e229-447e-aa6b-dd9c2872c751] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:10:00.547481 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-d602a763-abdc-4969-a348-d5366ddc3126 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:10:00.547859 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-d602a763-abdc-4969-a348-d5366ddc3126 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:10:00.548850 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-d602a763-abdc-4969-a348-d5366ddc3126 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:10:00.549293 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-d602a763-abdc-4969-a348-d5366ddc3126 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:10:00.703274 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-d602a763-abdc-4969-a348-d5366ddc3126 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8622ec5212c84d87b9b7c8f725012a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0143140d4f649478e36abcee284640c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:10:00.711576 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-d602a763-abdc-4969-a348-d5366ddc3126 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] 10.222.0.20 "GET /compute/v2.1/servers/1f96263a-e229-447e-aa6b-dd9c2872c751" status: 200 len: 1690 microversion: 2.1 time: 0.187251 Jul 01 04:10:00.712944 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 281/572] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:10:00 2022] GET /compute/v2.1/servers/1f96263a-e229-447e-aa6b-dd9c2872c751 => generated 1690 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:10:01.728960 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-f96893d8-78b8-4fa6-b28b-e992c01c6d02 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:10:01.729507 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-f96893d8-78b8-4fa6-b28b-e992c01c6d02 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] [instance: 1f96263a-e229-447e-aa6b-dd9c2872c751] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:10:01.737233 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-f96893d8-78b8-4fa6-b28b-e992c01c6d02 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:10:01.737697 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-f96893d8-78b8-4fa6-b28b-e992c01c6d02 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:10:01.738490 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-f96893d8-78b8-4fa6-b28b-e992c01c6d02 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:10:01.738932 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-f96893d8-78b8-4fa6-b28b-e992c01c6d02 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:10:01.913897 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-f96893d8-78b8-4fa6-b28b-e992c01c6d02 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8622ec5212c84d87b9b7c8f725012a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0143140d4f649478e36abcee284640c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:10:01.922412 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-f96893d8-78b8-4fa6-b28b-e992c01c6d02 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] 10.222.0.20 "GET /compute/v2.1/servers/1f96263a-e229-447e-aa6b-dd9c2872c751" status: 200 len: 1690 microversion: 2.1 time: 0.197351 Jul 01 04:10:01.923016 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 292/573] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:10:01 2022] GET /compute/v2.1/servers/1f96263a-e229-447e-aa6b-dd9c2872c751 => generated 1690 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 04:10:02.950822 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-161e978c-9e9b-413b-8ecb-7d821a90b1fd tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:10:02.951497 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-161e978c-9e9b-413b-8ecb-7d821a90b1fd tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] [instance: 1f96263a-e229-447e-aa6b-dd9c2872c751] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:10:02.957949 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-161e978c-9e9b-413b-8ecb-7d821a90b1fd tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:10:02.958403 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-161e978c-9e9b-413b-8ecb-7d821a90b1fd tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:10:02.959181 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-161e978c-9e9b-413b-8ecb-7d821a90b1fd tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:10:02.959654 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-161e978c-9e9b-413b-8ecb-7d821a90b1fd tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:10:03.102649 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-161e978c-9e9b-413b-8ecb-7d821a90b1fd tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8622ec5212c84d87b9b7c8f725012a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0143140d4f649478e36abcee284640c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:10:03.110966 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-161e978c-9e9b-413b-8ecb-7d821a90b1fd tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] 10.222.0.20 "GET /compute/v2.1/servers/1f96263a-e229-447e-aa6b-dd9c2872c751" status: 200 len: 1690 microversion: 2.1 time: 0.164007 Jul 01 04:10:03.117426 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 282/574] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:10:02 2022] GET /compute/v2.1/servers/1f96263a-e229-447e-aa6b-dd9c2872c751 => generated 1690 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:10:04.128245 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-1a9cbcbf-11b1-4307-89ad-b5de927bad01 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:10:04.128853 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-1a9cbcbf-11b1-4307-89ad-b5de927bad01 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] [instance: 1f96263a-e229-447e-aa6b-dd9c2872c751] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:10:04.130848 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG dbcounter [-] [118712] Writing DB stats nova_api:SELECT=30 {{(pid=118712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:10:04.135743 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-1a9cbcbf-11b1-4307-89ad-b5de927bad01 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:10:04.136200 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-1a9cbcbf-11b1-4307-89ad-b5de927bad01 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:10:04.136982 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-1a9cbcbf-11b1-4307-89ad-b5de927bad01 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:10:04.137432 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-1a9cbcbf-11b1-4307-89ad-b5de927bad01 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:10:04.285880 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-1a9cbcbf-11b1-4307-89ad-b5de927bad01 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8622ec5212c84d87b9b7c8f725012a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0143140d4f649478e36abcee284640c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:10:04.294069 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-1a9cbcbf-11b1-4307-89ad-b5de927bad01 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] 10.222.0.20 "GET /compute/v2.1/servers/1f96263a-e229-447e-aa6b-dd9c2872c751" status: 200 len: 1690 microversion: 2.1 time: 0.169955 Jul 01 04:10:04.294677 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 293/575] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:10:04 2022] GET /compute/v2.1/servers/1f96263a-e229-447e-aa6b-dd9c2872c751 => generated 1690 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:10:05.311780 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-5d459354-6e7b-4349-95d6-a1b5f2eb43f3 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:10:05.312373 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-5d459354-6e7b-4349-95d6-a1b5f2eb43f3 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] [instance: 1f96263a-e229-447e-aa6b-dd9c2872c751] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:10:05.314902 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG dbcounter [-] [118711] Writing DB stats nova_api:SELECT=42,nova_api:UPDATE=2 {{(pid=118711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:10:05.321176 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-5d459354-6e7b-4349-95d6-a1b5f2eb43f3 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:10:05.321176 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-5d459354-6e7b-4349-95d6-a1b5f2eb43f3 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:10:05.321580 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-5d459354-6e7b-4349-95d6-a1b5f2eb43f3 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:10:05.321789 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-5d459354-6e7b-4349-95d6-a1b5f2eb43f3 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:10:05.479880 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-5d459354-6e7b-4349-95d6-a1b5f2eb43f3 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8622ec5212c84d87b9b7c8f725012a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0143140d4f649478e36abcee284640c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:10:05.487870 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-5d459354-6e7b-4349-95d6-a1b5f2eb43f3 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] 10.222.0.20 "GET /compute/v2.1/servers/1f96263a-e229-447e-aa6b-dd9c2872c751" status: 200 len: 1690 microversion: 2.1 time: 0.179843 Jul 01 04:10:05.488454 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 283/576] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:10:05 2022] GET /compute/v2.1/servers/1f96263a-e229-447e-aa6b-dd9c2872c751 => generated 1690 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:10:06.510167 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-79008b5a-6c8e-46e1-ac09-ed3f9576996c tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:10:06.512250 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-79008b5a-6c8e-46e1-ac09-ed3f9576996c tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] [instance: 1f96263a-e229-447e-aa6b-dd9c2872c751] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:10:06.522729 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-79008b5a-6c8e-46e1-ac09-ed3f9576996c tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:10:06.524100 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-79008b5a-6c8e-46e1-ac09-ed3f9576996c tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:10:06.525541 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-79008b5a-6c8e-46e1-ac09-ed3f9576996c tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:10:06.526327 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-79008b5a-6c8e-46e1-ac09-ed3f9576996c tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:10:06.663807 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-79008b5a-6c8e-46e1-ac09-ed3f9576996c tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8622ec5212c84d87b9b7c8f725012a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0143140d4f649478e36abcee284640c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:10:06.664030 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [req-6bba6864-eb30-49e0-9f56-e3c94ec321a9 req-b267cab3-c1b3-491a-9c5a-4b10997c24c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f96263a-e229-447e-aa6b-dd9c2872c751", "name": "network-vif-deleted", "tag": "562a39f3-c337-47af-9f9d-fabcdc36a52b"}]} {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 04:10:06.674448 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [req-6bba6864-eb30-49e0-9f56-e3c94ec321a9 req-b267cab3-c1b3-491a-9c5a-4b10997c24c6 service nova] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:10:06.674905 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [req-6bba6864-eb30-49e0-9f56-e3c94ec321a9 req-b267cab3-c1b3-491a-9c5a-4b10997c24c6 service nova] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:10:06.677964 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-79008b5a-6c8e-46e1-ac09-ed3f9576996c tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] 10.222.0.20 "GET /compute/v2.1/servers/1f96263a-e229-447e-aa6b-dd9c2872c751" status: 200 len: 1622 microversion: 2.1 time: 0.174531 Jul 01 04:10:06.678795 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 294/577] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:10:06 2022] GET /compute/v2.1/servers/1f96263a-e229-447e-aa6b-dd9c2872c751 => generated 1622 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:10:06.693700 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.compute.server_external_events [req-6bba6864-eb30-49e0-9f56-e3c94ec321a9 req-b267cab3-c1b3-491a-9c5a-4b10997c24c6 service nova] Creating event network-vif-deleted:562a39f3-c337-47af-9f9d-fabcdc36a52b for instance 1f96263a-e229-447e-aa6b-dd9c2872c751 on hv-cinder-84684 Jul 01 04:10:06.696459 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [req-6bba6864-eb30-49e0-9f56-e3c94ec321a9 req-b267cab3-c1b3-491a-9c5a-4b10997c24c6 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036243 Jul 01 04:10:06.697386 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 284/578] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Jul 1 04:10:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 01 04:10:07.703585 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-c14cd029-358d-4a31-8cb9-3672b322d883 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:10:07.704479 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-c14cd029-358d-4a31-8cb9-3672b322d883 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] [instance: 1f96263a-e229-447e-aa6b-dd9c2872c751] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:10:07.713321 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-c14cd029-358d-4a31-8cb9-3672b322d883 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:10:07.713877 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-c14cd029-358d-4a31-8cb9-3672b322d883 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:10:07.714759 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-c14cd029-358d-4a31-8cb9-3672b322d883 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:10:07.715306 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-c14cd029-358d-4a31-8cb9-3672b322d883 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:10:07.750208 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-c14cd029-358d-4a31-8cb9-3672b322d883 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:10:07.750831 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-c14cd029-358d-4a31-8cb9-3672b322d883 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:10:07.751454 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.objects.instance [None req-c14cd029-358d-4a31-8cb9-3672b322d883 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lazy-loading 'fault' on Instance uuid 1f96263a-e229-447e-aa6b-dd9c2872c751 {{(pid=118712) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 04:10:07.797078 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-c14cd029-358d-4a31-8cb9-3672b322d883 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8622ec5212c84d87b9b7c8f725012a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0143140d4f649478e36abcee284640c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:10:07.805291 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-c14cd029-358d-4a31-8cb9-3672b322d883 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] 10.222.0.20 "GET /compute/v2.1/servers/1f96263a-e229-447e-aa6b-dd9c2872c751" status: 200 len: 1335 microversion: 2.1 time: 0.106369 Jul 01 04:10:07.805877 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 295/579] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:10:07 2022] GET /compute/v2.1/servers/1f96263a-e229-447e-aa6b-dd9c2872c751 => generated 1335 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:10:08.772827 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-a13dad27-6c5d-4919-90ee-7097c6344751 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1614744188"}} {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 04:10:08.773713 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-a13dad27-6c5d-4919-90ee-7097c6344751 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] [instance: 30391772-c0aa-468b-a414-c40c716a2481] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:10:08.780762 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-a13dad27-6c5d-4919-90ee-7097c6344751 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:10:08.781213 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-a13dad27-6c5d-4919-90ee-7097c6344751 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:10:08.782013 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-a13dad27-6c5d-4919-90ee-7097c6344751 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:10:08.782456 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-a13dad27-6c5d-4919-90ee-7097c6344751 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:10:08.826011 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-24d213c4-c4e4-4f75-a739-1891f6dee9c3 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:10:08.827647 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-24d213c4-c4e4-4f75-a739-1891f6dee9c3 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] [instance: 1f96263a-e229-447e-aa6b-dd9c2872c751] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:10:08.836489 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-24d213c4-c4e4-4f75-a739-1891f6dee9c3 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:10:08.837220 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-24d213c4-c4e4-4f75-a739-1891f6dee9c3 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:10:08.839090 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-24d213c4-c4e4-4f75-a739-1891f6dee9c3 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:10:08.839090 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-24d213c4-c4e4-4f75-a739-1891f6dee9c3 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:10:08.845822 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG dbcounter [-] [118712] Writing DB stats nova_cell1:SELECT=85 {{(pid=118712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:10:08.857302 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.wsgi [None req-24d213c4-c4e4-4f75-a739-1891f6dee9c3 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] HTTP exception thrown: Instance 1f96263a-e229-447e-aa6b-dd9c2872c751 could not be found. Jul 01 04:10:08.859878 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-24d213c4-c4e4-4f75-a739-1891f6dee9c3 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Request method failure captured: Jul 01 04:10:08.859878 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: request: GET /compute/v2.1/servers/1f96263a-e229-447e-aa6b-dd9c2872c751 HTTP/1.1 Jul 01 04:10:08.859878 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: Accept: application/json Jul 01 04:10:08.859878 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: Accept-Encoding: identity Jul 01 04:10:08.859878 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: Connection: close Jul 01 04:10:08.859878 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: Content-Length: 0 Jul 01 04:10:08.859878 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: Content-Type: application/json Jul 01 04:10:08.859878 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: Host: 10.222.0.20 Jul 01 04:10:08.859878 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: Openstack-System-Scope: None Jul 01 04:10:08.859878 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: User-Agent: python-urllib3/1.26.9 Jul 01 04:10:08.859878 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Auth-Token: gAAAAABivnJXigIdoKNrWhyC7v2FozD51jph_FSftzrdGxe-ICt_B7b0yUdhaKt3OJM8y8lEmoukGgxdiuXdffo0lQFNFHXOWALzvqer-sv1yOLbbxqWlc2p1ew_CWt-DcVsNFKW9wSaUR95HogWWAUd-o3FI2WtqElzxvPV0N7AryVuGkczdno Jul 01 04:10:08.859878 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Domain-Id: None Jul 01 04:10:08.859878 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Domain-Name: None Jul 01 04:10:08.859878 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Identity-Status: Confirmed Jul 01 04:10:08.859878 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Is-Admin-Project: True Jul 01 04:10:08.859878 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Project-Domain-Id: default Jul 01 04:10:08.859878 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Project-Domain-Name: Default Jul 01 04:10:08.859878 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Project-Id: f0143140d4f649478e36abcee284640c Jul 01 04:10:08.859878 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-508791321 Jul 01 04:10:08.859878 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Role: reader,member Jul 01 04:10:08.859878 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Roles: reader,member Jul 01 04:10:08.861563 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/f0143140d4f649478e36abcee284640c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_f0143140d4f649478e36abcee284640c", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f0143140d4f649478e36abcee284640c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f0143140d4f649478e36abcee284640c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}] Jul 01 04:10:08.861563 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Tenant: tempest-ServerRescueNegativeTestJSON-508791321 Jul 01 04:10:08.861563 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Tenant-Id: f0143140d4f649478e36abcee284640c Jul 01 04:10:08.861563 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-508791321 Jul 01 04:10:08.861563 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-User: tempest-ServerRescueNegativeTestJSON-508791321-project Jul 01 04:10:08.861563 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-User-Domain-Id: default Jul 01 04:10:08.861563 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-User-Domain-Name: Default Jul 01 04:10:08.861563 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-User-Id: 8622ec5212c84d87b9b7c8f725012a07 Jul 01 04:10:08.861563 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-User-Name: tempest-ServerRescueNegativeTestJSON-508791321-project Jul 01 04:10:08.861563 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: method: > Jul 01 04:10:08.861563 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: exception: Instance 1f96263a-e229-447e-aa6b-dd9c2872c751 could not be found. Jul 01 04:10:08.861563 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: action_args: {'id': '1f96263a-e229-447e-aa6b-dd9c2872c751'} Jul 01 04:10:08.862475 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 04:10:08.862475 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 04:10:08.862475 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 04:10:08.862475 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 04:10:08.862475 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 04:10:08.862475 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 04:10:08.862475 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 04:10:08.862475 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 04:10:08.862475 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 04:10:08.862475 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 04:10:08.862475 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1f96263a-e229-447e-aa6b-dd9c2872c751 could not be found. Jul 01 04:10:08.862475 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi Jul 01 04:10:08.862475 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 04:10:08.862475 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi Jul 01 04:10:08.862475 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 04:10:08.862475 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 04:10:08.862475 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 04:10:08.862475 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 04:10:08.862475 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 04:10:08.862475 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 04:10:08.868426 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 04:10:08.868426 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 04:10:08.868426 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 04:10:08.868426 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 04:10:08.868426 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 04:10:08.868426 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 04:10:08.868426 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 04:10:08.868426 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1f96263a-e229-447e-aa6b-dd9c2872c751 could not be found. Jul 01 04:10:08.868426 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi Jul 01 04:10:08.868426 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 04:10:08.868426 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi Jul 01 04:10:08.868426 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 04:10:08.868426 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 04:10:08.868426 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 04:10:08.868426 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 04:10:08.868426 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 04:10:08.868426 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1f96263a-e229-447e-aa6b-dd9c2872c751 could not be found. Jul 01 04:10:08.868426 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi Jul 01 04:10:08.869877 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-24d213c4-c4e4-4f75-a739-1891f6dee9c3 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Returning 404 to user: Instance 1f96263a-e229-447e-aa6b-dd9c2872c751 could not be found. {{(pid=118712) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 04:10:08.869877 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-24d213c4-c4e4-4f75-a739-1891f6dee9c3 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] 10.222.0.20 "GET /compute/v2.1/servers/1f96263a-e229-447e-aa6b-dd9c2872c751" status: 404 len: 111 microversion: 2.1 time: 0.040862 Jul 01 04:10:08.869877 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 296/580] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:10:08 2022] GET /compute/v2.1/servers/1f96263a-e229-447e-aa6b-dd9c2872c751 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 01 04:10:08.873601 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-b7aefbdd-c852-49ad-8fe8-afbf382ba795 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Calling method '.version_select at 0x7f99a0824040>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:10:08.975172 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.network.security_group_api [None req-a13dad27-6c5d-4919-90ee-7097c6344751 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Removing security group cc0d806f-a924-4f60-93da-afd13aaa1945 from port 0602970e-ed10-4c75-92d7-cd153851994b Jul 01 04:10:08.996839 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-b7aefbdd-c852-49ad-8fe8-afbf382ba795 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1631497420" status: 202 len: 0 microversion: 2.1 time: 0.127264 Jul 01 04:10:09.006353 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 297/581] 10.222.0.20 () {58 vars in 1220 bytes} [Fri Jul 1 04:10:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1631497420 => generated 0 bytes in 133 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 04:10:09.683454 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-a13dad27-6c5d-4919-90ee-7097c6344751 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] 10.222.0.20 "POST /compute/v2.1/servers/30391772-c0aa-468b-a414-c40c716a2481/action" status: 202 len: 0 microversion: 2.1 time: 0.914392 Jul 01 04:10:09.683454 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 285/582] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Jul 1 04:10:08 2022] POST /compute/v2.1/servers/30391772-c0aa-468b-a414-c40c716a2481/action => generated 0 bytes in 917 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 04:10:10.343492 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [req-7367994c-d743-4508-a86c-aadaeafd5c38 req-57258f19-0df0-4fa9-8121-f41db67ef54c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "30391772-c0aa-468b-a414-c40c716a2481", "tag": "0602970e-ed10-4c75-92d7-cd153851994b"}]} {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 04:10:10.354448 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [req-7367994c-d743-4508-a86c-aadaeafd5c38 req-57258f19-0df0-4fa9-8121-f41db67ef54c service nova] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:10:10.355072 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [req-7367994c-d743-4508-a86c-aadaeafd5c38 req-57258f19-0df0-4fa9-8121-f41db67ef54c service nova] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:10:10.393868 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.compute.server_external_events [req-7367994c-d743-4508-a86c-aadaeafd5c38 req-57258f19-0df0-4fa9-8121-f41db67ef54c service nova] Creating event network-changed:0602970e-ed10-4c75-92d7-cd153851994b for instance 30391772-c0aa-468b-a414-c40c716a2481 on hv-cinder-84684 Jul 01 04:10:10.405307 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [req-7367994c-d743-4508-a86c-aadaeafd5c38 req-57258f19-0df0-4fa9-8121-f41db67ef54c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.704170 Jul 01 04:10:10.405307 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 298/583] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Jul 1 04:10:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 01 04:10:12.188949 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-c8006f77-b7de-45df-a48c-9a17e3e2bd3e tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:10:12.190521 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-c8006f77-b7de-45df-a48c-9a17e3e2bd3e tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] [instance: 30391772-c0aa-468b-a414-c40c716a2481] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:10:12.203522 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-c8006f77-b7de-45df-a48c-9a17e3e2bd3e tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:10:12.204327 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-c8006f77-b7de-45df-a48c-9a17e3e2bd3e tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:10:12.205756 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-c8006f77-b7de-45df-a48c-9a17e3e2bd3e tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:10:12.206490 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-c8006f77-b7de-45df-a48c-9a17e3e2bd3e tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:10:12.311996 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [req-230f7967-1ab3-4d39-8199-19b9287f3a9a req-24644b5d-36e3-4f0f-bd4d-3da5e8b6f36f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "30391772-c0aa-468b-a414-c40c716a2481", "tag": "0602970e-ed10-4c75-92d7-cd153851994b"}]} {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 04:10:12.329322 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [req-230f7967-1ab3-4d39-8199-19b9287f3a9a req-24644b5d-36e3-4f0f-bd4d-3da5e8b6f36f service nova] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:10:12.329966 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [req-230f7967-1ab3-4d39-8199-19b9287f3a9a req-24644b5d-36e3-4f0f-bd4d-3da5e8b6f36f service nova] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:10:12.351992 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.compute.server_external_events [req-230f7967-1ab3-4d39-8199-19b9287f3a9a req-24644b5d-36e3-4f0f-bd4d-3da5e8b6f36f service nova] Creating event network-changed:0602970e-ed10-4c75-92d7-cd153851994b for instance 30391772-c0aa-468b-a414-c40c716a2481 on hv-cinder-84684 Jul 01 04:10:12.357970 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.objects.instance [None req-c8006f77-b7de-45df-a48c-9a17e3e2bd3e tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Lazy-loading 'services' on Instance uuid 30391772-c0aa-468b-a414-c40c716a2481 {{(pid=118711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 04:10:12.360261 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [req-230f7967-1ab3-4d39-8199-19b9287f3a9a req-24644b5d-36e3-4f0f-bd4d-3da5e8b6f36f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.174911 Jul 01 04:10:12.361277 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 299/584] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Jul 1 04:10:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 01 04:10:12.374647 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG dbcounter [-] [118711] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=118711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:10:12.723617 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-c8006f77-b7de-45df-a48c-9a17e3e2bd3e tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] 10.222.0.20 "DELETE /compute/v2.1/servers/30391772-c0aa-468b-a414-c40c716a2481/os-volume_attachments/a36e352d-600d-42c6-8c86-305bac800221" status: 202 len: 0 microversion: 2.1 time: 0.543456 Jul 01 04:10:12.728505 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 286/585] 10.222.0.20 () {58 vars in 1415 bytes} [Fri Jul 1 04:10:12 2022] DELETE /compute/v2.1/servers/30391772-c0aa-468b-a414-c40c716a2481/os-volume_attachments/a36e352d-600d-42c6-8c86-305bac800221 => generated 0 bytes in 546 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 04:10:12.741002 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-b08e88d1-bfa6-418e-b9fd-058e42b18942 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:10:12.743550 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-b08e88d1-bfa6-418e-b9fd-058e42b18942 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] [instance: 30391772-c0aa-468b-a414-c40c716a2481] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:10:12.755737 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-b08e88d1-bfa6-418e-b9fd-058e42b18942 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:10:12.756850 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-b08e88d1-bfa6-418e-b9fd-058e42b18942 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:10:12.758383 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-b08e88d1-bfa6-418e-b9fd-058e42b18942 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:10:12.759682 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-b08e88d1-bfa6-418e-b9fd-058e42b18942 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:10:12.817830 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-b08e88d1-bfa6-418e-b9fd-058e42b18942 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] 10.222.0.20 "GET /compute/v2.1/servers/30391772-c0aa-468b-a414-c40c716a2481/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.087517 Jul 01 04:10:12.818617 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 300/586] 10.222.0.20 () {58 vars in 1301 bytes} [Fri Jul 1 04:10:12 2022] GET /compute/v2.1/servers/30391772-c0aa-468b-a414-c40c716a2481/os-volume_attachments => generated 197 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 04:10:13.007605 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-caa1a733-03ef-4179-8a6b-a38e74a21176 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:10:13.008354 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-caa1a733-03ef-4179-8a6b-a38e74a21176 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] [instance: f0c5fb50-4991-45b2-803d-7bcfe51f7c34] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:10:13.016158 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-caa1a733-03ef-4179-8a6b-a38e74a21176 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:10:13.016702 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-caa1a733-03ef-4179-8a6b-a38e74a21176 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:10:13.017800 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-caa1a733-03ef-4179-8a6b-a38e74a21176 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:10:13.018493 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-caa1a733-03ef-4179-8a6b-a38e74a21176 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:10:13.049679 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-caa1a733-03ef-4179-8a6b-a38e74a21176 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] [instance: f0c5fb50-4991-45b2-803d-7bcfe51f7c34] Going to try to terminate instance {{(pid=118711) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 01 04:10:13.483859 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-caa1a733-03ef-4179-8a6b-a38e74a21176 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] 10.222.0.20 "DELETE /compute/v2.1/servers/f0c5fb50-4991-45b2-803d-7bcfe51f7c34" status: 204 len: 0 microversion: 2.1 time: 0.480110 Jul 01 04:10:13.484572 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 287/587] 10.222.0.20 () {58 vars in 1238 bytes} [Fri Jul 1 04:10:13 2022] DELETE /compute/v2.1/servers/f0c5fb50-4991-45b2-803d-7bcfe51f7c34 => generated 0 bytes in 482 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 01 04:10:13.505021 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-419a927d-fc80-496b-8d85-ff07755d2eb3 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:10:13.505631 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-419a927d-fc80-496b-8d85-ff07755d2eb3 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] [instance: f0c5fb50-4991-45b2-803d-7bcfe51f7c34] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:10:13.512498 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-419a927d-fc80-496b-8d85-ff07755d2eb3 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:10:13.512992 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-419a927d-fc80-496b-8d85-ff07755d2eb3 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:10:13.514364 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-419a927d-fc80-496b-8d85-ff07755d2eb3 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:10:13.514798 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-419a927d-fc80-496b-8d85-ff07755d2eb3 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:10:13.666481 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-419a927d-fc80-496b-8d85-ff07755d2eb3 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8622ec5212c84d87b9b7c8f725012a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0143140d4f649478e36abcee284640c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:10:13.682580 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-419a927d-fc80-496b-8d85-ff07755d2eb3 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] 10.222.0.20 "GET /compute/v2.1/servers/f0c5fb50-4991-45b2-803d-7bcfe51f7c34" status: 200 len: 1505 microversion: 2.1 time: 0.181429 Jul 01 04:10:13.683476 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 301/588] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:10:13 2022] GET /compute/v2.1/servers/f0c5fb50-4991-45b2-803d-7bcfe51f7c34 => generated 1505 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:10:13.832446 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-cb982d6e-8400-458f-99b1-295e643a70f1 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:10:13.833563 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-cb982d6e-8400-458f-99b1-295e643a70f1 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] [instance: 30391772-c0aa-468b-a414-c40c716a2481] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:10:13.839902 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-cb982d6e-8400-458f-99b1-295e643a70f1 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:10:13.840348 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-cb982d6e-8400-458f-99b1-295e643a70f1 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:10:13.841117 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-cb982d6e-8400-458f-99b1-295e643a70f1 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:10:13.841608 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-cb982d6e-8400-458f-99b1-295e643a70f1 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:10:13.877999 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-cb982d6e-8400-458f-99b1-295e643a70f1 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] 10.222.0.20 "GET /compute/v2.1/servers/30391772-c0aa-468b-a414-c40c716a2481/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050195 Jul 01 04:10:13.879107 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 288/589] 10.222.0.20 () {58 vars in 1301 bytes} [Fri Jul 1 04:10:13 2022] GET /compute/v2.1/servers/30391772-c0aa-468b-a414-c40c716a2481/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 01 04:10:14.701433 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-7b5696f9-ef74-46c5-a1d4-df39e4faeb97 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:10:14.702155 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-7b5696f9-ef74-46c5-a1d4-df39e4faeb97 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] [instance: f0c5fb50-4991-45b2-803d-7bcfe51f7c34] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:10:14.710430 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-7b5696f9-ef74-46c5-a1d4-df39e4faeb97 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:10:14.711168 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-7b5696f9-ef74-46c5-a1d4-df39e4faeb97 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:10:14.711614 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-7b5696f9-ef74-46c5-a1d4-df39e4faeb97 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:10:14.712058 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-7b5696f9-ef74-46c5-a1d4-df39e4faeb97 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:10:14.854471 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-7b5696f9-ef74-46c5-a1d4-df39e4faeb97 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8622ec5212c84d87b9b7c8f725012a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0143140d4f649478e36abcee284640c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:10:14.862208 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-7b5696f9-ef74-46c5-a1d4-df39e4faeb97 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] 10.222.0.20 "GET /compute/v2.1/servers/f0c5fb50-4991-45b2-803d-7bcfe51f7c34" status: 200 len: 1505 microversion: 2.1 time: 0.164880 Jul 01 04:10:14.862977 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 302/590] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:10:14 2022] GET /compute/v2.1/servers/f0c5fb50-4991-45b2-803d-7bcfe51f7c34 => generated 1505 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:10:14.890593 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-ab209075-8fb5-43bd-bb8f-af395f89b890 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:10:14.891554 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-ab209075-8fb5-43bd-bb8f-af395f89b890 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] [instance: 30391772-c0aa-468b-a414-c40c716a2481] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:10:14.898429 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-ab209075-8fb5-43bd-bb8f-af395f89b890 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:10:14.898933 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-ab209075-8fb5-43bd-bb8f-af395f89b890 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:10:14.899749 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-ab209075-8fb5-43bd-bb8f-af395f89b890 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:10:14.900185 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-ab209075-8fb5-43bd-bb8f-af395f89b890 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:10:14.931580 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-ab209075-8fb5-43bd-bb8f-af395f89b890 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] 10.222.0.20 "GET /compute/v2.1/servers/30391772-c0aa-468b-a414-c40c716a2481/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045261 Jul 01 04:10:14.932322 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 289/591] 10.222.0.20 () {58 vars in 1301 bytes} [Fri Jul 1 04:10:14 2022] GET /compute/v2.1/servers/30391772-c0aa-468b-a414-c40c716a2481/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 04:10:15.884405 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-02728367-e5da-4ec2-aa9c-66e68b1a72f5 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:10:15.885937 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-02728367-e5da-4ec2-aa9c-66e68b1a72f5 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] [instance: f0c5fb50-4991-45b2-803d-7bcfe51f7c34] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:10:15.893928 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-02728367-e5da-4ec2-aa9c-66e68b1a72f5 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:10:15.898596 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-02728367-e5da-4ec2-aa9c-66e68b1a72f5 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:10:15.898596 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-02728367-e5da-4ec2-aa9c-66e68b1a72f5 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:10:15.898596 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-02728367-e5da-4ec2-aa9c-66e68b1a72f5 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:10:15.951649 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-bb530ea0-5310-4f17-964c-fdf862933dd7 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:10:15.952922 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-bb530ea0-5310-4f17-964c-fdf862933dd7 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] [instance: 30391772-c0aa-468b-a414-c40c716a2481] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:10:15.960069 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-bb530ea0-5310-4f17-964c-fdf862933dd7 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:10:15.960525 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-bb530ea0-5310-4f17-964c-fdf862933dd7 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:10:15.961312 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-bb530ea0-5310-4f17-964c-fdf862933dd7 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:10:15.961821 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-bb530ea0-5310-4f17-964c-fdf862933dd7 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:10:15.996109 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-bb530ea0-5310-4f17-964c-fdf862933dd7 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] 10.222.0.20 "GET /compute/v2.1/servers/30391772-c0aa-468b-a414-c40c716a2481/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.051006 Jul 01 04:10:15.996711 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 290/592] 10.222.0.20 () {58 vars in 1301 bytes} [Fri Jul 1 04:10:15 2022] GET /compute/v2.1/servers/30391772-c0aa-468b-a414-c40c716a2481/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 01 04:10:16.007508 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-9f7e6c00-7c36-4695-b9d5-e40ae0bd3806 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:10:16.008012 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-9f7e6c00-7c36-4695-b9d5-e40ae0bd3806 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] [instance: 30391772-c0aa-468b-a414-c40c716a2481] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:10:16.014759 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-9f7e6c00-7c36-4695-b9d5-e40ae0bd3806 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:10:16.015218 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-9f7e6c00-7c36-4695-b9d5-e40ae0bd3806 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:10:16.016065 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-9f7e6c00-7c36-4695-b9d5-e40ae0bd3806 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:10:16.016541 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-9f7e6c00-7c36-4695-b9d5-e40ae0bd3806 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:10:16.057334 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-02728367-e5da-4ec2-aa9c-66e68b1a72f5 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8622ec5212c84d87b9b7c8f725012a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0143140d4f649478e36abcee284640c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:10:16.070797 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-02728367-e5da-4ec2-aa9c-66e68b1a72f5 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] 10.222.0.20 "GET /compute/v2.1/servers/f0c5fb50-4991-45b2-803d-7bcfe51f7c34" status: 200 len: 1505 microversion: 2.1 time: 0.190898 Jul 01 04:10:16.070797 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 303/593] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:10:15 2022] GET /compute/v2.1/servers/f0c5fb50-4991-45b2-803d-7bcfe51f7c34 => generated 1505 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 04:10:16.158952 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.wsgi [None req-9f7e6c00-7c36-4695-b9d5-e40ae0bd3806 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] HTTP exception thrown: Instance 30391772-c0aa-468b-a414-c40c716a2481 is not attached to volume a36e352d-600d-42c6-8c86-305bac800221 Jul 01 04:10:16.162690 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-9f7e6c00-7c36-4695-b9d5-e40ae0bd3806 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Request method failure captured: Jul 01 04:10:16.162690 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: request: DELETE /compute/v2.1/servers/30391772-c0aa-468b-a414-c40c716a2481/os-volume_attachments/a36e352d-600d-42c6-8c86-305bac800221 HTTP/1.1 Jul 01 04:10:16.162690 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: Accept: application/json Jul 01 04:10:16.162690 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: Accept-Encoding: identity Jul 01 04:10:16.162690 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: Connection: close Jul 01 04:10:16.162690 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: Content-Length: 0 Jul 01 04:10:16.162690 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: Content-Type: application/json Jul 01 04:10:16.162690 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: Host: 10.222.0.20 Jul 01 04:10:16.162690 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: Openstack-System-Scope: None Jul 01 04:10:16.162690 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: User-Agent: python-urllib3/1.26.9 Jul 01 04:10:16.162690 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-Auth-Token: gAAAAABivnLJp10Vzlq8uN7U6Iy6Ai-Bqz7hdaD7F8guMhNiHdfaTl761I3kTWS6z4-e395W98fD3YdiG7aSs_D543Hbl4BbqBxX9ee8ppng6sJ6-Xgr1b9wqmTzPlH7PThf-Q1yucvwlYffogHS5_DmMmkNSmfb23flUW60DzJ-7wYfoqTW-n0 Jul 01 04:10:16.162690 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-Domain-Id: None Jul 01 04:10:16.162690 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-Domain-Name: None Jul 01 04:10:16.162690 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-Identity-Status: Confirmed Jul 01 04:10:16.162690 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-Is-Admin-Project: True Jul 01 04:10:16.162690 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-Project-Domain-Id: default Jul 01 04:10:16.162690 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-Project-Domain-Name: Default Jul 01 04:10:16.162690 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-Project-Id: 2940ca71c4b24b5facc194b61d748a11 Jul 01 04:10:16.162690 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-Project-Name: tempest-TestMinimumBasicScenario-835627828 Jul 01 04:10:16.162690 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-Role: reader,member Jul 01 04:10:16.162690 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-Roles: reader,member Jul 01 04:10:16.165322 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/2940ca71c4b24b5facc194b61d748a11"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_2940ca71c4b24b5facc194b61d748a11", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2940ca71c4b24b5facc194b61d748a11"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2940ca71c4b24b5facc194b61d748a11"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}] Jul 01 04:10:16.165322 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-Tenant: tempest-TestMinimumBasicScenario-835627828 Jul 01 04:10:16.165322 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-Tenant-Id: 2940ca71c4b24b5facc194b61d748a11 Jul 01 04:10:16.165322 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-Tenant-Name: tempest-TestMinimumBasicScenario-835627828 Jul 01 04:10:16.165322 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-User: tempest-TestMinimumBasicScenario-835627828-project Jul 01 04:10:16.165322 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-User-Domain-Id: default Jul 01 04:10:16.165322 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-User-Domain-Name: Default Jul 01 04:10:16.165322 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-User-Id: abc2e04754884398afc999d423e2a711 Jul 01 04:10:16.165322 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-User-Name: tempest-TestMinimumBasicScenario-835627828-project Jul 01 04:10:16.165322 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: method: > Jul 01 04:10:16.165322 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: exception: Instance 30391772-c0aa-468b-a414-c40c716a2481 is not attached to volume a36e352d-600d-42c6-8c86-305bac800221 Jul 01 04:10:16.168418 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: action_args: {'server_id': '30391772-c0aa-468b-a414-c40c716a2481', 'id': 'a36e352d-600d-42c6-8c86-305bac800221'} Jul 01 04:10:16.168418 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 04:10:16.168418 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 04:10:16.168418 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jul 01 04:10:16.168418 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jul 01 04:10:16.168418 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 01 04:10:16.168418 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 01 04:10:16.168418 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jul 01 04:10:16.168418 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jul 01 04:10:16.168418 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id a36e352d-600d-42c6-8c86-305bac800221. Jul 01 04:10:16.168418 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi Jul 01 04:10:16.168418 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 04:10:16.168418 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi Jul 01 04:10:16.168418 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 04:10:16.168418 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 04:10:16.168418 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 04:10:16.168418 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 04:10:16.168418 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 04:10:16.168418 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 04:10:16.172965 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 04:10:16.172965 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jul 01 04:10:16.172965 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 01 04:10:16.172965 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 30391772-c0aa-468b-a414-c40c716a2481 is not attached to volume a36e352d-600d-42c6-8c86-305bac800221 Jul 01 04:10:16.172965 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi Jul 01 04:10:16.172965 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 04:10:16.172965 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi Jul 01 04:10:16.172965 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 04:10:16.172965 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 04:10:16.172965 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 04:10:16.172965 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 04:10:16.172965 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 04:10:16.172965 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 30391772-c0aa-468b-a414-c40c716a2481 is not attached to volume a36e352d-600d-42c6-8c86-305bac800221 Jul 01 04:10:16.172965 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi Jul 01 04:10:16.172965 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-9f7e6c00-7c36-4695-b9d5-e40ae0bd3806 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Returning 404 to user: Instance 30391772-c0aa-468b-a414-c40c716a2481 is not attached to volume a36e352d-600d-42c6-8c86-305bac800221 {{(pid=118711) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 04:10:16.176380 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-9f7e6c00-7c36-4695-b9d5-e40ae0bd3806 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] 10.222.0.20 "DELETE /compute/v2.1/servers/30391772-c0aa-468b-a414-c40c716a2481/os-volume_attachments/a36e352d-600d-42c6-8c86-305bac800221" status: 404 len: 154 microversion: 2.1 time: 0.161814 Jul 01 04:10:16.176380 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 291/594] 10.222.0.20 () {58 vars in 1415 bytes} [Fri Jul 1 04:10:16 2022] DELETE /compute/v2.1/servers/30391772-c0aa-468b-a414-c40c716a2481/os-volume_attachments/a36e352d-600d-42c6-8c86-305bac800221 => generated 154 bytes in 164 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 01 04:10:16.179412 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [req-c75a5f42-da4f-4658-ba02-4a267f104725 req-4fb9468a-f242-4363-a225-4bd9bd82a464 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f0c5fb50-4991-45b2-803d-7bcfe51f7c34", "name": "network-vif-deleted", "tag": "36a5bee1-6336-437a-af48-b9f466c3f69d"}]} {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 04:10:16.195012 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [req-c75a5f42-da4f-4658-ba02-4a267f104725 req-4fb9468a-f242-4363-a225-4bd9bd82a464 service nova] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:10:16.195945 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [req-c75a5f42-da4f-4658-ba02-4a267f104725 req-4fb9468a-f242-4363-a225-4bd9bd82a464 service nova] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:10:16.212274 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.compute.server_external_events [req-c75a5f42-da4f-4658-ba02-4a267f104725 req-4fb9468a-f242-4363-a225-4bd9bd82a464 service nova] Creating event network-vif-deleted:36a5bee1-6336-437a-af48-b9f466c3f69d for instance f0c5fb50-4991-45b2-803d-7bcfe51f7c34 on hv-cinder-84684 Jul 01 04:10:16.222378 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [req-c75a5f42-da4f-4658-ba02-4a267f104725 req-4fb9468a-f242-4363-a225-4bd9bd82a464 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052626 Jul 01 04:10:16.223263 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 304/595] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Jul 1 04:10:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 04:10:17.093700 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-5e588550-b644-4119-b7ff-7ebd9776840b tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:10:17.094339 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-5e588550-b644-4119-b7ff-7ebd9776840b tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] [instance: f0c5fb50-4991-45b2-803d-7bcfe51f7c34] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:10:17.101394 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-5e588550-b644-4119-b7ff-7ebd9776840b tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:10:17.101844 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-5e588550-b644-4119-b7ff-7ebd9776840b tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:10:17.102622 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-5e588550-b644-4119-b7ff-7ebd9776840b tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:10:17.103057 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-5e588550-b644-4119-b7ff-7ebd9776840b tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:10:17.141240 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-5e588550-b644-4119-b7ff-7ebd9776840b tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:10:17.142030 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-5e588550-b644-4119-b7ff-7ebd9776840b tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:10:17.142818 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.objects.instance [None req-5e588550-b644-4119-b7ff-7ebd9776840b tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lazy-loading 'fault' on Instance uuid f0c5fb50-4991-45b2-803d-7bcfe51f7c34 {{(pid=118711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 04:10:17.194108 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-5e588550-b644-4119-b7ff-7ebd9776840b tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8622ec5212c84d87b9b7c8f725012a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0143140d4f649478e36abcee284640c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:10:17.202941 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-5e588550-b644-4119-b7ff-7ebd9776840b tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] 10.222.0.20 "GET /compute/v2.1/servers/f0c5fb50-4991-45b2-803d-7bcfe51f7c34" status: 200 len: 1309 microversion: 2.1 time: 0.113612 Jul 01 04:10:17.203571 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 292/596] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:10:17 2022] GET /compute/v2.1/servers/f0c5fb50-4991-45b2-803d-7bcfe51f7c34 => generated 1309 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:10:17.512274 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-2f32f13c-0f63-46d3-bfe9-5f1b0162015f tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:10:17.513529 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-2f32f13c-0f63-46d3-bfe9-5f1b0162015f tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] [instance: 30391772-c0aa-468b-a414-c40c716a2481] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:10:17.521632 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-2f32f13c-0f63-46d3-bfe9-5f1b0162015f tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:10:17.522082 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-2f32f13c-0f63-46d3-bfe9-5f1b0162015f tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:10:17.522867 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-2f32f13c-0f63-46d3-bfe9-5f1b0162015f tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:10:17.523317 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-2f32f13c-0f63-46d3-bfe9-5f1b0162015f tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:10:17.551522 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-2f32f13c-0f63-46d3-bfe9-5f1b0162015f tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] [instance: 30391772-c0aa-468b-a414-c40c716a2481] Going to try to terminate instance {{(pid=118712) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 01 04:10:17.839056 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-2f32f13c-0f63-46d3-bfe9-5f1b0162015f tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] 10.222.0.20 "DELETE /compute/v2.1/servers/30391772-c0aa-468b-a414-c40c716a2481" status: 204 len: 0 microversion: 2.1 time: 0.330954 Jul 01 04:10:17.839712 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 305/597] 10.222.0.20 () {58 vars in 1238 bytes} [Fri Jul 1 04:10:17 2022] DELETE /compute/v2.1/servers/30391772-c0aa-468b-a414-c40c716a2481 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 01 04:10:17.849365 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-7d189251-1242-4d28-8878-96165585ee35 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:10:17.850729 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-7d189251-1242-4d28-8878-96165585ee35 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] [instance: 30391772-c0aa-468b-a414-c40c716a2481] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:10:17.856694 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-7d189251-1242-4d28-8878-96165585ee35 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:10:17.857139 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-7d189251-1242-4d28-8878-96165585ee35 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:10:17.858478 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-7d189251-1242-4d28-8878-96165585ee35 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:10:17.858915 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-7d189251-1242-4d28-8878-96165585ee35 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:10:18.008223 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-7d189251-1242-4d28-8878-96165585ee35 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abc2e04754884398afc999d423e2a711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2940ca71c4b24b5facc194b61d748a11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:10:18.016137 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-7d189251-1242-4d28-8878-96165585ee35 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] 10.222.0.20 "GET /compute/v2.1/servers/30391772-c0aa-468b-a414-c40c716a2481" status: 200 len: 1553 microversion: 2.1 time: 0.171000 Jul 01 04:10:18.016707 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 293/598] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:10:17 2022] GET /compute/v2.1/servers/30391772-c0aa-468b-a414-c40c716a2481 => generated 1553 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:10:18.221992 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-d6b98116-7b2c-4d25-9a1c-2d49584903d7 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:10:18.223003 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-d6b98116-7b2c-4d25-9a1c-2d49584903d7 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] [instance: f0c5fb50-4991-45b2-803d-7bcfe51f7c34] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:10:18.238232 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-d6b98116-7b2c-4d25-9a1c-2d49584903d7 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:10:18.238232 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-d6b98116-7b2c-4d25-9a1c-2d49584903d7 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:10:18.238232 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-d6b98116-7b2c-4d25-9a1c-2d49584903d7 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:10:18.238232 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-d6b98116-7b2c-4d25-9a1c-2d49584903d7 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:10:18.251590 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.wsgi [None req-d6b98116-7b2c-4d25-9a1c-2d49584903d7 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] HTTP exception thrown: Instance f0c5fb50-4991-45b2-803d-7bcfe51f7c34 could not be found. Jul 01 04:10:18.253471 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-d6b98116-7b2c-4d25-9a1c-2d49584903d7 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Request method failure captured: Jul 01 04:10:18.253471 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: request: GET /compute/v2.1/servers/f0c5fb50-4991-45b2-803d-7bcfe51f7c34 HTTP/1.1 Jul 01 04:10:18.253471 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: Accept: application/json Jul 01 04:10:18.253471 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: Accept-Encoding: identity Jul 01 04:10:18.253471 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: Connection: close Jul 01 04:10:18.253471 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: Content-Length: 0 Jul 01 04:10:18.253471 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: Content-Type: application/json Jul 01 04:10:18.253471 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: Host: 10.222.0.20 Jul 01 04:10:18.253471 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: Openstack-System-Scope: None Jul 01 04:10:18.253471 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: User-Agent: python-urllib3/1.26.9 Jul 01 04:10:18.253471 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Auth-Token: gAAAAABivnJXigIdoKNrWhyC7v2FozD51jph_FSftzrdGxe-ICt_B7b0yUdhaKt3OJM8y8lEmoukGgxdiuXdffo0lQFNFHXOWALzvqer-sv1yOLbbxqWlc2p1ew_CWt-DcVsNFKW9wSaUR95HogWWAUd-o3FI2WtqElzxvPV0N7AryVuGkczdno Jul 01 04:10:18.253471 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Domain-Id: None Jul 01 04:10:18.253471 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Domain-Name: None Jul 01 04:10:18.253471 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Identity-Status: Confirmed Jul 01 04:10:18.253471 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Is-Admin-Project: True Jul 01 04:10:18.253471 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Project-Domain-Id: default Jul 01 04:10:18.253471 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Project-Domain-Name: Default Jul 01 04:10:18.253471 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Project-Id: f0143140d4f649478e36abcee284640c Jul 01 04:10:18.253471 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-508791321 Jul 01 04:10:18.253471 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Role: reader,member Jul 01 04:10:18.253471 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Roles: reader,member Jul 01 04:10:18.255269 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/f0143140d4f649478e36abcee284640c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_f0143140d4f649478e36abcee284640c", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f0143140d4f649478e36abcee284640c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f0143140d4f649478e36abcee284640c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}] Jul 01 04:10:18.255269 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Tenant: tempest-ServerRescueNegativeTestJSON-508791321 Jul 01 04:10:18.255269 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Tenant-Id: f0143140d4f649478e36abcee284640c Jul 01 04:10:18.255269 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-508791321 Jul 01 04:10:18.255269 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-User: tempest-ServerRescueNegativeTestJSON-508791321-project Jul 01 04:10:18.255269 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-User-Domain-Id: default Jul 01 04:10:18.255269 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-User-Domain-Name: Default Jul 01 04:10:18.255269 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-User-Id: 8622ec5212c84d87b9b7c8f725012a07 Jul 01 04:10:18.255269 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-User-Name: tempest-ServerRescueNegativeTestJSON-508791321-project Jul 01 04:10:18.255269 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: method: > Jul 01 04:10:18.255269 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: exception: Instance f0c5fb50-4991-45b2-803d-7bcfe51f7c34 could not be found. Jul 01 04:10:18.255269 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: action_args: {'id': 'f0c5fb50-4991-45b2-803d-7bcfe51f7c34'} Jul 01 04:10:18.256431 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 04:10:18.256431 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 04:10:18.256431 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 04:10:18.256431 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 04:10:18.256431 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 04:10:18.256431 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 04:10:18.256431 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 04:10:18.256431 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 04:10:18.256431 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 04:10:18.256431 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 04:10:18.256431 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f0c5fb50-4991-45b2-803d-7bcfe51f7c34 could not be found. Jul 01 04:10:18.256431 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi Jul 01 04:10:18.256431 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 04:10:18.256431 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi Jul 01 04:10:18.256431 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 04:10:18.256431 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 04:10:18.256431 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 04:10:18.256431 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 04:10:18.256431 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 04:10:18.256431 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 04:10:18.257787 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 04:10:18.257787 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 04:10:18.257787 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 04:10:18.257787 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 04:10:18.257787 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 04:10:18.257787 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 04:10:18.257787 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 04:10:18.257787 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f0c5fb50-4991-45b2-803d-7bcfe51f7c34 could not be found. Jul 01 04:10:18.257787 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi Jul 01 04:10:18.257787 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 04:10:18.257787 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi Jul 01 04:10:18.257787 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 04:10:18.257787 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 04:10:18.257787 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 04:10:18.257787 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 04:10:18.257787 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 04:10:18.257787 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f0c5fb50-4991-45b2-803d-7bcfe51f7c34 could not be found. Jul 01 04:10:18.257787 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi Jul 01 04:10:18.258925 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-d6b98116-7b2c-4d25-9a1c-2d49584903d7 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Returning 404 to user: Instance f0c5fb50-4991-45b2-803d-7bcfe51f7c34 could not be found. {{(pid=118712) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 04:10:18.258925 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-d6b98116-7b2c-4d25-9a1c-2d49584903d7 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] 10.222.0.20 "GET /compute/v2.1/servers/f0c5fb50-4991-45b2-803d-7bcfe51f7c34" status: 404 len: 111 microversion: 2.1 time: 0.037941 Jul 01 04:10:18.258925 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 306/599] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:10:18 2022] GET /compute/v2.1/servers/f0c5fb50-4991-45b2-803d-7bcfe51f7c34 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 04:10:18.266002 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-ed87d517-f63b-4bbd-b9f6-3c3551ff86a1 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:10:18.266627 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-ed87d517-f63b-4bbd-b9f6-3c3551ff86a1 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] [instance: cd6bb9ca-aa57-4dc3-98bc-8e3194003673] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:10:18.273566 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-ed87d517-f63b-4bbd-b9f6-3c3551ff86a1 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:10:18.274035 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-ed87d517-f63b-4bbd-b9f6-3c3551ff86a1 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:10:18.274942 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-ed87d517-f63b-4bbd-b9f6-3c3551ff86a1 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:10:18.275417 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-ed87d517-f63b-4bbd-b9f6-3c3551ff86a1 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:10:18.313810 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-ed87d517-f63b-4bbd-b9f6-3c3551ff86a1 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] [instance: cd6bb9ca-aa57-4dc3-98bc-8e3194003673] Going to try to terminate instance {{(pid=118711) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 01 04:10:18.833321 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-ed87d517-f63b-4bbd-b9f6-3c3551ff86a1 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] 10.222.0.20 "DELETE /compute/v2.1/servers/cd6bb9ca-aa57-4dc3-98bc-8e3194003673" status: 204 len: 0 microversion: 2.1 time: 0.572435 Jul 01 04:10:18.833904 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 294/600] 10.222.0.20 () {58 vars in 1238 bytes} [Fri Jul 1 04:10:18 2022] DELETE /compute/v2.1/servers/cd6bb9ca-aa57-4dc3-98bc-8e3194003673 => generated 0 bytes in 574 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 01 04:10:18.843028 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-7eb48900-2d07-4cd9-a718-d685b99da3d9 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:10:18.843628 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-7eb48900-2d07-4cd9-a718-d685b99da3d9 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] [instance: cd6bb9ca-aa57-4dc3-98bc-8e3194003673] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:10:18.850557 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-7eb48900-2d07-4cd9-a718-d685b99da3d9 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:10:18.851036 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-7eb48900-2d07-4cd9-a718-d685b99da3d9 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:10:18.851845 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-7eb48900-2d07-4cd9-a718-d685b99da3d9 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:10:18.852287 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-7eb48900-2d07-4cd9-a718-d685b99da3d9 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:10:18.993308 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-7eb48900-2d07-4cd9-a718-d685b99da3d9 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8622ec5212c84d87b9b7c8f725012a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0143140d4f649478e36abcee284640c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:10:19.002507 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-7eb48900-2d07-4cd9-a718-d685b99da3d9 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] 10.222.0.20 "GET /compute/v2.1/servers/cd6bb9ca-aa57-4dc3-98bc-8e3194003673" status: 200 len: 1523 microversion: 2.1 time: 0.164082 Jul 01 04:10:19.003175 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 307/601] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:10:18 2022] GET /compute/v2.1/servers/cd6bb9ca-aa57-4dc3-98bc-8e3194003673 => generated 1523 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:10:19.034545 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-4b84a285-b897-4054-8251-425b656e039d tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:10:19.035306 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-4b84a285-b897-4054-8251-425b656e039d tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] [instance: 30391772-c0aa-468b-a414-c40c716a2481] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:10:19.041493 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-4b84a285-b897-4054-8251-425b656e039d tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:10:19.041948 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-4b84a285-b897-4054-8251-425b656e039d tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:10:19.042709 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-4b84a285-b897-4054-8251-425b656e039d tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:10:19.043135 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-4b84a285-b897-4054-8251-425b656e039d tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:10:19.187898 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-4b84a285-b897-4054-8251-425b656e039d tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abc2e04754884398afc999d423e2a711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2940ca71c4b24b5facc194b61d748a11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:10:19.201975 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-4b84a285-b897-4054-8251-425b656e039d tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] 10.222.0.20 "GET /compute/v2.1/servers/30391772-c0aa-468b-a414-c40c716a2481" status: 200 len: 1553 microversion: 2.1 time: 0.172091 Jul 01 04:10:19.203027 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 295/602] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:10:19 2022] GET /compute/v2.1/servers/30391772-c0aa-468b-a414-c40c716a2481 => generated 1553 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:10:20.020145 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-260e919f-bbcb-48ff-bb7b-9b69cd7bd9d2 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:10:20.020752 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-260e919f-bbcb-48ff-bb7b-9b69cd7bd9d2 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] [instance: cd6bb9ca-aa57-4dc3-98bc-8e3194003673] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:10:20.027334 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-260e919f-bbcb-48ff-bb7b-9b69cd7bd9d2 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:10:20.027800 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-260e919f-bbcb-48ff-bb7b-9b69cd7bd9d2 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:10:20.028582 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-260e919f-bbcb-48ff-bb7b-9b69cd7bd9d2 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:10:20.029024 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-260e919f-bbcb-48ff-bb7b-9b69cd7bd9d2 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:10:20.166948 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-260e919f-bbcb-48ff-bb7b-9b69cd7bd9d2 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8622ec5212c84d87b9b7c8f725012a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0143140d4f649478e36abcee284640c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:10:20.175409 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-260e919f-bbcb-48ff-bb7b-9b69cd7bd9d2 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] 10.222.0.20 "GET /compute/v2.1/servers/cd6bb9ca-aa57-4dc3-98bc-8e3194003673" status: 200 len: 1523 microversion: 2.1 time: 0.159194 Jul 01 04:10:20.175995 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 308/603] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:10:20 2022] GET /compute/v2.1/servers/cd6bb9ca-aa57-4dc3-98bc-8e3194003673 => generated 1523 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:10:20.227116 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-056672d9-48dc-43f9-8f37-aa47bb65c200 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:10:20.227930 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-056672d9-48dc-43f9-8f37-aa47bb65c200 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] [instance: 30391772-c0aa-468b-a414-c40c716a2481] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:10:20.235415 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-056672d9-48dc-43f9-8f37-aa47bb65c200 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:10:20.235885 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-056672d9-48dc-43f9-8f37-aa47bb65c200 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:10:20.236670 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-056672d9-48dc-43f9-8f37-aa47bb65c200 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:10:20.237112 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-056672d9-48dc-43f9-8f37-aa47bb65c200 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:10:20.380565 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-056672d9-48dc-43f9-8f37-aa47bb65c200 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abc2e04754884398afc999d423e2a711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2940ca71c4b24b5facc194b61d748a11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:10:20.389307 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-056672d9-48dc-43f9-8f37-aa47bb65c200 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] 10.222.0.20 "GET /compute/v2.1/servers/30391772-c0aa-468b-a414-c40c716a2481" status: 200 len: 1553 microversion: 2.1 time: 0.166228 Jul 01 04:10:20.389997 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 296/604] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:10:20 2022] GET /compute/v2.1/servers/30391772-c0aa-468b-a414-c40c716a2481 => generated 1553 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:10:21.194791 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-cc4eb9f9-64cd-4d68-993c-1e7529614452 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:10:21.195456 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-cc4eb9f9-64cd-4d68-993c-1e7529614452 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] [instance: cd6bb9ca-aa57-4dc3-98bc-8e3194003673] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:10:21.202802 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-cc4eb9f9-64cd-4d68-993c-1e7529614452 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:10:21.203292 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-cc4eb9f9-64cd-4d68-993c-1e7529614452 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:10:21.204084 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-cc4eb9f9-64cd-4d68-993c-1e7529614452 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:10:21.204531 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-cc4eb9f9-64cd-4d68-993c-1e7529614452 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:10:21.349605 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-cc4eb9f9-64cd-4d68-993c-1e7529614452 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8622ec5212c84d87b9b7c8f725012a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0143140d4f649478e36abcee284640c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:10:21.358620 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-cc4eb9f9-64cd-4d68-993c-1e7529614452 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] 10.222.0.20 "GET /compute/v2.1/servers/cd6bb9ca-aa57-4dc3-98bc-8e3194003673" status: 200 len: 1523 microversion: 2.1 time: 0.167835 Jul 01 04:10:21.359312 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 309/605] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:10:21 2022] GET /compute/v2.1/servers/cd6bb9ca-aa57-4dc3-98bc-8e3194003673 => generated 1523 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:10:21.407910 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-5169bbaa-1004-48d6-adb5-229263708970 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:10:21.408568 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-5169bbaa-1004-48d6-adb5-229263708970 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] [instance: 30391772-c0aa-468b-a414-c40c716a2481] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:10:21.415612 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-5169bbaa-1004-48d6-adb5-229263708970 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:10:21.416063 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-5169bbaa-1004-48d6-adb5-229263708970 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:10:21.416842 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-5169bbaa-1004-48d6-adb5-229263708970 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:10:21.417279 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-5169bbaa-1004-48d6-adb5-229263708970 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:10:21.568222 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-5169bbaa-1004-48d6-adb5-229263708970 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abc2e04754884398afc999d423e2a711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2940ca71c4b24b5facc194b61d748a11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:10:21.576416 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-5169bbaa-1004-48d6-adb5-229263708970 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] 10.222.0.20 "GET /compute/v2.1/servers/30391772-c0aa-468b-a414-c40c716a2481" status: 200 len: 1553 microversion: 2.1 time: 0.173488 Jul 01 04:10:21.577008 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 297/606] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:10:21 2022] GET /compute/v2.1/servers/30391772-c0aa-468b-a414-c40c716a2481 => generated 1553 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:10:22.380164 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-57fc6efe-2f4c-4cda-b4fc-df9216449eb3 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:10:22.382127 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-57fc6efe-2f4c-4cda-b4fc-df9216449eb3 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] [instance: cd6bb9ca-aa57-4dc3-98bc-8e3194003673] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:10:22.394707 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-57fc6efe-2f4c-4cda-b4fc-df9216449eb3 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:10:22.395544 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-57fc6efe-2f4c-4cda-b4fc-df9216449eb3 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:10:22.397150 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-57fc6efe-2f4c-4cda-b4fc-df9216449eb3 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:10:22.398222 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-57fc6efe-2f4c-4cda-b4fc-df9216449eb3 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:10:22.561139 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [req-3bc2515c-a5cd-40c2-828c-4432accb0dc4 req-ff65cb1a-cb60-4e5b-a7a4-9f57fe7349ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "30391772-c0aa-468b-a414-c40c716a2481", "name": "network-vif-deleted", "tag": "0602970e-ed10-4c75-92d7-cd153851994b"}]} {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 04:10:22.572727 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [req-3bc2515c-a5cd-40c2-828c-4432accb0dc4 req-ff65cb1a-cb60-4e5b-a7a4-9f57fe7349ac service nova] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:10:22.573333 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [req-3bc2515c-a5cd-40c2-828c-4432accb0dc4 req-ff65cb1a-cb60-4e5b-a7a4-9f57fe7349ac service nova] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:10:22.591340 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.compute.server_external_events [req-3bc2515c-a5cd-40c2-828c-4432accb0dc4 req-ff65cb1a-cb60-4e5b-a7a4-9f57fe7349ac service nova] Creating event network-vif-deleted:0602970e-ed10-4c75-92d7-cd153851994b for instance 30391772-c0aa-468b-a414-c40c716a2481 on hv-cinder-84684 Jul 01 04:10:22.598383 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [req-3bc2515c-a5cd-40c2-828c-4432accb0dc4 req-ff65cb1a-cb60-4e5b-a7a4-9f57fe7349ac service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041263 Jul 01 04:10:22.599171 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 298/607] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Jul 1 04:10:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 04:10:22.608032 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-cf2af997-77b0-4eb9-aacd-19618b47f1f7 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:10:22.609130 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-cf2af997-77b0-4eb9-aacd-19618b47f1f7 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] [instance: 30391772-c0aa-468b-a414-c40c716a2481] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:10:22.617238 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-cf2af997-77b0-4eb9-aacd-19618b47f1f7 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:10:22.619045 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-cf2af997-77b0-4eb9-aacd-19618b47f1f7 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:10:22.620329 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-cf2af997-77b0-4eb9-aacd-19618b47f1f7 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:10:22.621114 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-cf2af997-77b0-4eb9-aacd-19618b47f1f7 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:10:22.663783 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-57fc6efe-2f4c-4cda-b4fc-df9216449eb3 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8622ec5212c84d87b9b7c8f725012a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0143140d4f649478e36abcee284640c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:10:22.681051 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-57fc6efe-2f4c-4cda-b4fc-df9216449eb3 tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] 10.222.0.20 "GET /compute/v2.1/servers/cd6bb9ca-aa57-4dc3-98bc-8e3194003673" status: 200 len: 1523 microversion: 2.1 time: 0.306911 Jul 01 04:10:22.682563 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 310/608] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:10:22 2022] GET /compute/v2.1/servers/cd6bb9ca-aa57-4dc3-98bc-8e3194003673 => generated 1523 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:10:22.713671 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-cf2af997-77b0-4eb9-aacd-19618b47f1f7 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abc2e04754884398afc999d423e2a711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2940ca71c4b24b5facc194b61d748a11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:10:22.731656 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-cf2af997-77b0-4eb9-aacd-19618b47f1f7 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] 10.222.0.20 "GET /compute/v2.1/servers/30391772-c0aa-468b-a414-c40c716a2481" status: 200 len: 1511 microversion: 2.1 time: 0.130298 Jul 01 04:10:22.732573 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 299/609] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:10:22 2022] GET /compute/v2.1/servers/30391772-c0aa-468b-a414-c40c716a2481 => generated 1511 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:10:23.062579 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [req-1f00948b-a292-4a54-bbac-de4ea0f35ef5 req-a6dfaccb-ae15-4723-b1c1-8777460062de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd6bb9ca-aa57-4dc3-98bc-8e3194003673", "name": "network-vif-deleted", "tag": "733c3087-abf2-445f-b346-a1bea93c6bdb"}]} {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 04:10:23.072817 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [req-1f00948b-a292-4a54-bbac-de4ea0f35ef5 req-a6dfaccb-ae15-4723-b1c1-8777460062de service nova] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:10:23.073317 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [req-1f00948b-a292-4a54-bbac-de4ea0f35ef5 req-a6dfaccb-ae15-4723-b1c1-8777460062de service nova] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:10:23.086202 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.compute.server_external_events [req-1f00948b-a292-4a54-bbac-de4ea0f35ef5 req-a6dfaccb-ae15-4723-b1c1-8777460062de service nova] Creating event network-vif-deleted:733c3087-abf2-445f-b346-a1bea93c6bdb for instance cd6bb9ca-aa57-4dc3-98bc-8e3194003673 on hv-cinder-84684 Jul 01 04:10:23.091372 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [req-1f00948b-a292-4a54-bbac-de4ea0f35ef5 req-a6dfaccb-ae15-4723-b1c1-8777460062de service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034692 Jul 01 04:10:23.094891 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 311/610] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Jul 1 04:10:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 04:10:23.701579 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-aae51096-87aa-432f-af57-46dbfee56acd tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:10:23.702157 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-aae51096-87aa-432f-af57-46dbfee56acd tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] [instance: cd6bb9ca-aa57-4dc3-98bc-8e3194003673] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:10:23.709097 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-aae51096-87aa-432f-af57-46dbfee56acd tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:10:23.709555 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-aae51096-87aa-432f-af57-46dbfee56acd tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:10:23.710439 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-aae51096-87aa-432f-af57-46dbfee56acd tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:10:23.710876 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-aae51096-87aa-432f-af57-46dbfee56acd tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:10:23.715554 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG dbcounter [-] [118711] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=118711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:10:23.744476 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-aae51096-87aa-432f-af57-46dbfee56acd tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:10:23.744975 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-aae51096-87aa-432f-af57-46dbfee56acd tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:10:23.745432 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.objects.instance [None req-aae51096-87aa-432f-af57-46dbfee56acd tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lazy-loading 'fault' on Instance uuid cd6bb9ca-aa57-4dc3-98bc-8e3194003673 {{(pid=118711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 04:10:23.754937 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-7429119d-ccb6-485b-97b8-c919e0c5b07a tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:10:23.755878 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-7429119d-ccb6-485b-97b8-c919e0c5b07a tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] [instance: 30391772-c0aa-468b-a414-c40c716a2481] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:10:23.762813 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-7429119d-ccb6-485b-97b8-c919e0c5b07a tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:10:23.763433 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-7429119d-ccb6-485b-97b8-c919e0c5b07a tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:10:23.764813 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-7429119d-ccb6-485b-97b8-c919e0c5b07a tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:10:23.765414 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-7429119d-ccb6-485b-97b8-c919e0c5b07a tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:10:23.780679 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.wsgi [None req-7429119d-ccb6-485b-97b8-c919e0c5b07a tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] HTTP exception thrown: Instance 30391772-c0aa-468b-a414-c40c716a2481 could not be found. Jul 01 04:10:23.782467 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-7429119d-ccb6-485b-97b8-c919e0c5b07a tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Request method failure captured: Jul 01 04:10:23.782467 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: request: GET /compute/v2.1/servers/30391772-c0aa-468b-a414-c40c716a2481 HTTP/1.1 Jul 01 04:10:23.782467 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: Accept: application/json Jul 01 04:10:23.782467 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: Accept-Encoding: identity Jul 01 04:10:23.782467 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: Connection: close Jul 01 04:10:23.782467 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: Content-Length: 0 Jul 01 04:10:23.782467 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: Content-Type: application/json Jul 01 04:10:23.782467 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: Host: 10.222.0.20 Jul 01 04:10:23.782467 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: Openstack-System-Scope: None Jul 01 04:10:23.782467 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: User-Agent: python-urllib3/1.26.9 Jul 01 04:10:23.782467 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Auth-Token: gAAAAABivnLJp10Vzlq8uN7U6Iy6Ai-Bqz7hdaD7F8guMhNiHdfaTl761I3kTWS6z4-e395W98fD3YdiG7aSs_D543Hbl4BbqBxX9ee8ppng6sJ6-Xgr1b9wqmTzPlH7PThf-Q1yucvwlYffogHS5_DmMmkNSmfb23flUW60DzJ-7wYfoqTW-n0 Jul 01 04:10:23.782467 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Domain-Id: None Jul 01 04:10:23.782467 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Domain-Name: None Jul 01 04:10:23.782467 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Identity-Status: Confirmed Jul 01 04:10:23.782467 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Is-Admin-Project: True Jul 01 04:10:23.782467 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Project-Domain-Id: default Jul 01 04:10:23.782467 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Project-Domain-Name: Default Jul 01 04:10:23.782467 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Project-Id: 2940ca71c4b24b5facc194b61d748a11 Jul 01 04:10:23.782467 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Project-Name: tempest-TestMinimumBasicScenario-835627828 Jul 01 04:10:23.782467 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Role: reader,member Jul 01 04:10:23.782467 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Roles: reader,member Jul 01 04:10:23.787461 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/2940ca71c4b24b5facc194b61d748a11"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_2940ca71c4b24b5facc194b61d748a11", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2940ca71c4b24b5facc194b61d748a11"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2940ca71c4b24b5facc194b61d748a11"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}] Jul 01 04:10:23.787461 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Tenant: tempest-TestMinimumBasicScenario-835627828 Jul 01 04:10:23.787461 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Tenant-Id: 2940ca71c4b24b5facc194b61d748a11 Jul 01 04:10:23.787461 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Tenant-Name: tempest-TestMinimumBasicScenario-835627828 Jul 01 04:10:23.787461 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-User: tempest-TestMinimumBasicScenario-835627828-project Jul 01 04:10:23.787461 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-User-Domain-Id: default Jul 01 04:10:23.787461 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-User-Domain-Name: Default Jul 01 04:10:23.787461 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-User-Id: abc2e04754884398afc999d423e2a711 Jul 01 04:10:23.787461 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-User-Name: tempest-TestMinimumBasicScenario-835627828-project Jul 01 04:10:23.787461 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: method: > Jul 01 04:10:23.787461 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: exception: Instance 30391772-c0aa-468b-a414-c40c716a2481 could not be found. Jul 01 04:10:23.787461 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: action_args: {'id': '30391772-c0aa-468b-a414-c40c716a2481'} Jul 01 04:10:23.789138 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 04:10:23.789138 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 04:10:23.789138 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 04:10:23.789138 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 04:10:23.789138 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 04:10:23.789138 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 04:10:23.789138 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 04:10:23.789138 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 04:10:23.789138 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 04:10:23.789138 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 04:10:23.789138 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 30391772-c0aa-468b-a414-c40c716a2481 could not be found. Jul 01 04:10:23.789138 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi Jul 01 04:10:23.789138 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 04:10:23.789138 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi Jul 01 04:10:23.789138 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 04:10:23.789138 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 04:10:23.789138 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 04:10:23.789138 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 04:10:23.789138 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 04:10:23.789138 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 04:10:23.792001 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 04:10:23.792001 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 04:10:23.792001 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 04:10:23.792001 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 04:10:23.792001 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 04:10:23.792001 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 04:10:23.792001 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 04:10:23.792001 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 30391772-c0aa-468b-a414-c40c716a2481 could not be found. Jul 01 04:10:23.792001 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi Jul 01 04:10:23.792001 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 04:10:23.792001 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi Jul 01 04:10:23.792001 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 04:10:23.792001 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 04:10:23.792001 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 04:10:23.792001 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 04:10:23.792001 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 04:10:23.792001 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 30391772-c0aa-468b-a414-c40c716a2481 could not be found. Jul 01 04:10:23.792001 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi Jul 01 04:10:23.795718 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-7429119d-ccb6-485b-97b8-c919e0c5b07a tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Returning 404 to user: Instance 30391772-c0aa-468b-a414-c40c716a2481 could not be found. {{(pid=118712) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 04:10:23.795718 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-7429119d-ccb6-485b-97b8-c919e0c5b07a tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] 10.222.0.20 "GET /compute/v2.1/servers/30391772-c0aa-468b-a414-c40c716a2481" status: 404 len: 111 microversion: 2.1 time: 0.034946 Jul 01 04:10:23.795718 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 312/611] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:10:23 2022] GET /compute/v2.1/servers/30391772-c0aa-468b-a414-c40c716a2481 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 01 04:10:23.796396 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-aae51096-87aa-432f-af57-46dbfee56acd tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8622ec5212c84d87b9b7c8f725012a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0143140d4f649478e36abcee284640c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:10:23.796608 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-8c22e5be-5902-474b-9ffa-80e58fbde042 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] Calling method '.version_select at 0x7f99a07ec550>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:10:23.802037 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-aae51096-87aa-432f-af57-46dbfee56acd tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] 10.222.0.20 "GET /compute/v2.1/servers/cd6bb9ca-aa57-4dc3-98bc-8e3194003673" status: 200 len: 1312 microversion: 2.1 time: 0.105245 Jul 01 04:10:23.802914 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 300/612] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:10:23 2022] GET /compute/v2.1/servers/cd6bb9ca-aa57-4dc3-98bc-8e3194003673 => generated 1312 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:10:23.882206 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-8c22e5be-5902-474b-9ffa-80e58fbde042 tempest-TestMinimumBasicScenario-835627828 tempest-TestMinimumBasicScenario-835627828-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-466542453" status: 202 len: 0 microversion: 2.1 time: 0.092033 Jul 01 04:10:23.883251 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 313/613] 10.222.0.20 () {58 vars in 1268 bytes} [Fri Jul 1 04:10:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-466542453 => generated 0 bytes in 94 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 04:10:24.820186 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-4a9eb9f5-b365-44bf-8757-2241bed6394f tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:10:24.820778 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-4a9eb9f5-b365-44bf-8757-2241bed6394f tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] [instance: cd6bb9ca-aa57-4dc3-98bc-8e3194003673] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:10:24.828990 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-4a9eb9f5-b365-44bf-8757-2241bed6394f tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:10:24.829442 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-4a9eb9f5-b365-44bf-8757-2241bed6394f tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:10:24.830304 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-4a9eb9f5-b365-44bf-8757-2241bed6394f tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:10:24.830748 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-4a9eb9f5-b365-44bf-8757-2241bed6394f tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:10:24.845769 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.wsgi [None req-4a9eb9f5-b365-44bf-8757-2241bed6394f tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] HTTP exception thrown: Instance cd6bb9ca-aa57-4dc3-98bc-8e3194003673 could not be found. Jul 01 04:10:24.847570 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-4a9eb9f5-b365-44bf-8757-2241bed6394f tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Request method failure captured: Jul 01 04:10:24.847570 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: request: GET /compute/v2.1/servers/cd6bb9ca-aa57-4dc3-98bc-8e3194003673 HTTP/1.1 Jul 01 04:10:24.847570 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: Accept: application/json Jul 01 04:10:24.847570 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: Accept-Encoding: identity Jul 01 04:10:24.847570 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: Connection: close Jul 01 04:10:24.847570 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: Content-Length: 0 Jul 01 04:10:24.847570 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: Content-Type: application/json Jul 01 04:10:24.847570 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: Host: 10.222.0.20 Jul 01 04:10:24.847570 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: Openstack-System-Scope: None Jul 01 04:10:24.847570 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: User-Agent: python-urllib3/1.26.9 Jul 01 04:10:24.847570 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-Auth-Token: gAAAAABivnJXigIdoKNrWhyC7v2FozD51jph_FSftzrdGxe-ICt_B7b0yUdhaKt3OJM8y8lEmoukGgxdiuXdffo0lQFNFHXOWALzvqer-sv1yOLbbxqWlc2p1ew_CWt-DcVsNFKW9wSaUR95HogWWAUd-o3FI2WtqElzxvPV0N7AryVuGkczdno Jul 01 04:10:24.847570 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-Domain-Id: None Jul 01 04:10:24.847570 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-Domain-Name: None Jul 01 04:10:24.847570 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-Identity-Status: Confirmed Jul 01 04:10:24.847570 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-Is-Admin-Project: True Jul 01 04:10:24.847570 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-Project-Domain-Id: default Jul 01 04:10:24.847570 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-Project-Domain-Name: Default Jul 01 04:10:24.847570 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-Project-Id: f0143140d4f649478e36abcee284640c Jul 01 04:10:24.847570 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-508791321 Jul 01 04:10:24.847570 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-Role: reader,member Jul 01 04:10:24.847570 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-Roles: reader,member Jul 01 04:10:24.849184 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/f0143140d4f649478e36abcee284640c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_f0143140d4f649478e36abcee284640c", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f0143140d4f649478e36abcee284640c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f0143140d4f649478e36abcee284640c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}] Jul 01 04:10:24.849184 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-Tenant: tempest-ServerRescueNegativeTestJSON-508791321 Jul 01 04:10:24.849184 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-Tenant-Id: f0143140d4f649478e36abcee284640c Jul 01 04:10:24.849184 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-508791321 Jul 01 04:10:24.849184 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-User: tempest-ServerRescueNegativeTestJSON-508791321-project Jul 01 04:10:24.849184 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-User-Domain-Id: default Jul 01 04:10:24.849184 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-User-Domain-Name: Default Jul 01 04:10:24.849184 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-User-Id: 8622ec5212c84d87b9b7c8f725012a07 Jul 01 04:10:24.849184 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-User-Name: tempest-ServerRescueNegativeTestJSON-508791321-project Jul 01 04:10:24.849184 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: method: > Jul 01 04:10:24.849184 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: exception: Instance cd6bb9ca-aa57-4dc3-98bc-8e3194003673 could not be found. Jul 01 04:10:24.849184 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: action_args: {'id': 'cd6bb9ca-aa57-4dc3-98bc-8e3194003673'} Jul 01 04:10:24.850021 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 04:10:24.850021 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 04:10:24.850021 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 04:10:24.850021 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 04:10:24.850021 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 04:10:24.850021 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 04:10:24.850021 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 04:10:24.850021 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 04:10:24.850021 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 04:10:24.850021 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 04:10:24.850021 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cd6bb9ca-aa57-4dc3-98bc-8e3194003673 could not be found. Jul 01 04:10:24.850021 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi Jul 01 04:10:24.850021 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 04:10:24.850021 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi Jul 01 04:10:24.850021 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 04:10:24.850021 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 04:10:24.850021 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 04:10:24.850021 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 04:10:24.850021 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 04:10:24.850021 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 04:10:24.851445 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 04:10:24.851445 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 04:10:24.851445 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 04:10:24.851445 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 04:10:24.851445 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 04:10:24.851445 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 04:10:24.851445 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 04:10:24.851445 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cd6bb9ca-aa57-4dc3-98bc-8e3194003673 could not be found. Jul 01 04:10:24.851445 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi Jul 01 04:10:24.851445 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 04:10:24.851445 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi Jul 01 04:10:24.851445 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 04:10:24.851445 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 04:10:24.851445 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 04:10:24.851445 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 04:10:24.851445 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 04:10:24.851445 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cd6bb9ca-aa57-4dc3-98bc-8e3194003673 could not be found. Jul 01 04:10:24.851445 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi Jul 01 04:10:24.852675 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-4a9eb9f5-b365-44bf-8757-2241bed6394f tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] Returning 404 to user: Instance cd6bb9ca-aa57-4dc3-98bc-8e3194003673 could not be found. {{(pid=118711) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 04:10:24.852675 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-4a9eb9f5-b365-44bf-8757-2241bed6394f tempest-ServerRescueNegativeTestJSON-508791321 tempest-ServerRescueNegativeTestJSON-508791321-project] 10.222.0.20 "GET /compute/v2.1/servers/cd6bb9ca-aa57-4dc3-98bc-8e3194003673" status: 404 len: 111 microversion: 2.1 time: 0.032895 Jul 01 04:10:24.852675 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 301/614] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:10:24 2022] GET /compute/v2.1/servers/cd6bb9ca-aa57-4dc3-98bc-8e3194003673 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 04:10:26.075394 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-6b3583d6-7da1-4e9a-baad-75b4167ba9e4 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:10:26.076539 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-6b3583d6-7da1-4e9a-baad-75b4167ba9e4 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] [instance: 5f84252c-dfc7-4c95-a315-5ac40d997d51] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:10:26.085632 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-6b3583d6-7da1-4e9a-baad-75b4167ba9e4 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:10:26.086272 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-6b3583d6-7da1-4e9a-baad-75b4167ba9e4 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:10:26.089860 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-6b3583d6-7da1-4e9a-baad-75b4167ba9e4 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:10:26.090330 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-6b3583d6-7da1-4e9a-baad-75b4167ba9e4 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:10:26.121553 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-6b3583d6-7da1-4e9a-baad-75b4167ba9e4 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] 10.222.0.20 "GET /compute/v2.1/servers/5f84252c-dfc7-4c95-a315-5ac40d997d51/ips" status: 200 len: 150 microversion: 2.20 time: 0.265807 Jul 01 04:10:26.122025 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 314/615] 10.222.0.20 () {60 vars in 1288 bytes} [Fri Jul 1 04:10:25 2022] GET /compute/v2.1/servers/5f84252c-dfc7-4c95-a315-5ac40d997d51/ips => generated 150 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 01 04:10:28.418285 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-4f195e74-8a5b-4d70-adf8-f47122827a27 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 04:10:28.420925 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-4f195e74-8a5b-4d70-adf8-f47122827a27 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] [instance: 5f84252c-dfc7-4c95-a315-5ac40d997d51] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:10:28.429063 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-4f195e74-8a5b-4d70-adf8-f47122827a27 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:10:28.429781 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-4f195e74-8a5b-4d70-adf8-f47122827a27 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:10:28.431532 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-4f195e74-8a5b-4d70-adf8-f47122827a27 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:10:28.432197 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-4f195e74-8a5b-4d70-adf8-f47122827a27 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:10:28.463670 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.objects.instance [None req-4f195e74-8a5b-4d70-adf8-f47122827a27 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lazy-loading 'flavor' on Instance uuid 5f84252c-dfc7-4c95-a315-5ac40d997d51 {{(pid=118711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 04:10:29.071573 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-4f195e74-8a5b-4d70-adf8-f47122827a27 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] 10.222.0.20 "POST /compute/v2.1/servers/5f84252c-dfc7-4c95-a315-5ac40d997d51/action" status: 202 len: 0 microversion: 2.20 time: 0.656900 Jul 01 04:10:29.074614 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 302/616] 10.222.0.20 () {62 vars in 1318 bytes} [Fri Jul 1 04:10:28 2022] POST /compute/v2.1/servers/5f84252c-dfc7-4c95-a315-5ac40d997d51/action => generated 0 bytes in 659 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jul 01 04:10:29.081365 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-fc621995-0288-42f8-872a-e15a3333273a tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:10:29.082135 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-fc621995-0288-42f8-872a-e15a3333273a tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] [instance: 5f84252c-dfc7-4c95-a315-5ac40d997d51] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:10:29.090550 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-fc621995-0288-42f8-872a-e15a3333273a tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:10:29.092202 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-fc621995-0288-42f8-872a-e15a3333273a tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:10:29.093613 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-fc621995-0288-42f8-872a-e15a3333273a tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:10:29.094246 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-fc621995-0288-42f8-872a-e15a3333273a tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:10:29.291847 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-fc621995-0288-42f8-872a-e15a3333273a tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:10:29.302186 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-fc621995-0288-42f8-872a-e15a3333273a tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:10:29.303798 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-fc621995-0288-42f8-872a-e15a3333273a tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:10:29.305109 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-fc621995-0288-42f8-872a-e15a3333273a tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] 10.222.0.20 "GET /compute/v2.1/servers/5f84252c-dfc7-4c95-a315-5ac40d997d51" status: 200 len: 1721 microversion: 2.20 time: 0.227805 Jul 01 04:10:29.316388 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 315/617] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Jul 1 04:10:29 2022] GET /compute/v2.1/servers/5f84252c-dfc7-4c95-a315-5ac40d997d51 => generated 1721 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 04:10:30.326234 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-541a2dbc-6dc5-4f5e-9b31-d58b014c6167 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:10:30.327756 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-541a2dbc-6dc5-4f5e-9b31-d58b014c6167 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] [instance: 5f84252c-dfc7-4c95-a315-5ac40d997d51] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:10:30.338918 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-541a2dbc-6dc5-4f5e-9b31-d58b014c6167 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:10:30.340954 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-541a2dbc-6dc5-4f5e-9b31-d58b014c6167 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:10:30.345097 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-541a2dbc-6dc5-4f5e-9b31-d58b014c6167 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:10:30.346956 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-541a2dbc-6dc5-4f5e-9b31-d58b014c6167 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:10:30.625522 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-541a2dbc-6dc5-4f5e-9b31-d58b014c6167 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:10:30.636576 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-541a2dbc-6dc5-4f5e-9b31-d58b014c6167 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:10:30.639010 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-541a2dbc-6dc5-4f5e-9b31-d58b014c6167 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:10:30.640359 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-541a2dbc-6dc5-4f5e-9b31-d58b014c6167 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] 10.222.0.20 "GET /compute/v2.1/servers/5f84252c-dfc7-4c95-a315-5ac40d997d51" status: 200 len: 1721 microversion: 2.20 time: 0.318734 Jul 01 04:10:30.641053 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 303/618] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Jul 1 04:10:30 2022] GET /compute/v2.1/servers/5f84252c-dfc7-4c95-a315-5ac40d997d51 => generated 1721 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 04:10:31.660983 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-608aefd6-18d4-4956-9e6c-0b2965083e2b tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:10:31.662077 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-608aefd6-18d4-4956-9e6c-0b2965083e2b tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] [instance: 5f84252c-dfc7-4c95-a315-5ac40d997d51] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:10:31.671792 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-608aefd6-18d4-4956-9e6c-0b2965083e2b tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:10:31.672603 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-608aefd6-18d4-4956-9e6c-0b2965083e2b tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:10:31.673383 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-608aefd6-18d4-4956-9e6c-0b2965083e2b tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:10:31.673819 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-608aefd6-18d4-4956-9e6c-0b2965083e2b tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:10:31.916757 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-608aefd6-18d4-4956-9e6c-0b2965083e2b tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:10:31.931990 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-608aefd6-18d4-4956-9e6c-0b2965083e2b tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:10:31.933676 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-608aefd6-18d4-4956-9e6c-0b2965083e2b tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:10:31.934911 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-608aefd6-18d4-4956-9e6c-0b2965083e2b tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] 10.222.0.20 "GET /compute/v2.1/servers/5f84252c-dfc7-4c95-a315-5ac40d997d51" status: 200 len: 1721 microversion: 2.20 time: 0.278365 Jul 01 04:10:31.935515 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 316/619] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Jul 1 04:10:31 2022] GET /compute/v2.1/servers/5f84252c-dfc7-4c95-a315-5ac40d997d51 => generated 1721 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 04:10:32.953970 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-4e6a55c5-9e4c-431b-829d-cc9238b8cc77 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:10:32.954853 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-4e6a55c5-9e4c-431b-829d-cc9238b8cc77 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] [instance: 5f84252c-dfc7-4c95-a315-5ac40d997d51] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:10:32.963570 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-4e6a55c5-9e4c-431b-829d-cc9238b8cc77 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:10:32.964140 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-4e6a55c5-9e4c-431b-829d-cc9238b8cc77 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:10:32.965053 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-4e6a55c5-9e4c-431b-829d-cc9238b8cc77 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:10:32.966641 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-4e6a55c5-9e4c-431b-829d-cc9238b8cc77 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:10:33.177979 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-4e6a55c5-9e4c-431b-829d-cc9238b8cc77 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:10:33.187581 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-4e6a55c5-9e4c-431b-829d-cc9238b8cc77 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:10:33.189408 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-4e6a55c5-9e4c-431b-829d-cc9238b8cc77 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:10:33.191187 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-4e6a55c5-9e4c-431b-829d-cc9238b8cc77 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] 10.222.0.20 "GET /compute/v2.1/servers/5f84252c-dfc7-4c95-a315-5ac40d997d51" status: 200 len: 1721 microversion: 2.20 time: 0.241494 Jul 01 04:10:33.202367 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 304/620] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Jul 1 04:10:32 2022] GET /compute/v2.1/servers/5f84252c-dfc7-4c95-a315-5ac40d997d51 => generated 1721 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 04:10:34.210525 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-4cfa5dfc-8698-4f24-bed3-e2c0bf2f0ffc tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:10:34.211136 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-4cfa5dfc-8698-4f24-bed3-e2c0bf2f0ffc tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] [instance: 5f84252c-dfc7-4c95-a315-5ac40d997d51] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:10:34.213337 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG dbcounter [-] [118712] Writing DB stats nova_api:SELECT=57,nova_api:DELETE=2,nova_api:UPDATE=1 {{(pid=118712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:10:34.218867 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-4cfa5dfc-8698-4f24-bed3-e2c0bf2f0ffc tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:10:34.219492 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-4cfa5dfc-8698-4f24-bed3-e2c0bf2f0ffc tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:10:34.223674 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-4cfa5dfc-8698-4f24-bed3-e2c0bf2f0ffc tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:10:34.223674 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-4cfa5dfc-8698-4f24-bed3-e2c0bf2f0ffc tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:10:34.492015 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-4cfa5dfc-8698-4f24-bed3-e2c0bf2f0ffc tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:10:34.501884 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-4cfa5dfc-8698-4f24-bed3-e2c0bf2f0ffc tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:10:34.510276 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-4cfa5dfc-8698-4f24-bed3-e2c0bf2f0ffc tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:10:34.511528 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-4cfa5dfc-8698-4f24-bed3-e2c0bf2f0ffc tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] 10.222.0.20 "GET /compute/v2.1/servers/5f84252c-dfc7-4c95-a315-5ac40d997d51" status: 200 len: 1721 microversion: 2.20 time: 0.305237 Jul 01 04:10:34.512074 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 317/621] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Jul 1 04:10:34 2022] GET /compute/v2.1/servers/5f84252c-dfc7-4c95-a315-5ac40d997d51 => generated 1721 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 04:10:35.534673 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-894277f0-b33e-49c6-af37-66c6317fd3f0 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:10:35.535920 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-894277f0-b33e-49c6-af37-66c6317fd3f0 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] [instance: 5f84252c-dfc7-4c95-a315-5ac40d997d51] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:10:35.543641 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-894277f0-b33e-49c6-af37-66c6317fd3f0 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:10:35.544280 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-894277f0-b33e-49c6-af37-66c6317fd3f0 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:10:35.545903 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-894277f0-b33e-49c6-af37-66c6317fd3f0 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:10:35.546644 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-894277f0-b33e-49c6-af37-66c6317fd3f0 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:10:35.810516 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-894277f0-b33e-49c6-af37-66c6317fd3f0 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:10:35.828776 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-894277f0-b33e-49c6-af37-66c6317fd3f0 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:10:35.833753 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-894277f0-b33e-49c6-af37-66c6317fd3f0 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:10:35.863530 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-894277f0-b33e-49c6-af37-66c6317fd3f0 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] 10.222.0.20 "GET /compute/v2.1/servers/5f84252c-dfc7-4c95-a315-5ac40d997d51" status: 200 len: 1721 microversion: 2.20 time: 0.331928 Jul 01 04:10:35.865052 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 305/622] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Jul 1 04:10:35 2022] GET /compute/v2.1/servers/5f84252c-dfc7-4c95-a315-5ac40d997d51 => generated 1721 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 04:10:36.887024 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-a9c67f8d-441b-4cab-b2ff-20861323d2a7 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:10:36.888598 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-a9c67f8d-441b-4cab-b2ff-20861323d2a7 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] [instance: 5f84252c-dfc7-4c95-a315-5ac40d997d51] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:10:36.898428 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-a9c67f8d-441b-4cab-b2ff-20861323d2a7 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:10:36.899624 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-a9c67f8d-441b-4cab-b2ff-20861323d2a7 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:10:36.900932 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-a9c67f8d-441b-4cab-b2ff-20861323d2a7 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:10:36.901707 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-a9c67f8d-441b-4cab-b2ff-20861323d2a7 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:10:36.909271 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG dbcounter [-] [118712] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:10:37.167453 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-a9c67f8d-441b-4cab-b2ff-20861323d2a7 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:10:37.176757 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-a9c67f8d-441b-4cab-b2ff-20861323d2a7 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:10:37.178362 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-a9c67f8d-441b-4cab-b2ff-20861323d2a7 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:10:37.179852 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-a9c67f8d-441b-4cab-b2ff-20861323d2a7 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] 10.222.0.20 "GET /compute/v2.1/servers/5f84252c-dfc7-4c95-a315-5ac40d997d51" status: 200 len: 1721 microversion: 2.20 time: 0.299076 Jul 01 04:10:37.180625 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 318/623] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Jul 1 04:10:36 2022] GET /compute/v2.1/servers/5f84252c-dfc7-4c95-a315-5ac40d997d51 => generated 1721 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 04:10:38.199452 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-bb209459-777a-48a7-8205-874d3921f688 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:10:38.200956 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-bb209459-777a-48a7-8205-874d3921f688 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] [instance: 5f84252c-dfc7-4c95-a315-5ac40d997d51] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:10:38.227122 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG dbcounter [-] [118711] Writing DB stats nova_api:SELECT=60,nova_api:UPDATE=2 {{(pid=118711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:10:38.244557 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-bb209459-777a-48a7-8205-874d3921f688 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:10:38.244557 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-bb209459-777a-48a7-8205-874d3921f688 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:10:38.247891 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-bb209459-777a-48a7-8205-874d3921f688 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:10:38.248969 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-bb209459-777a-48a7-8205-874d3921f688 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:10:38.495409 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-bb209459-777a-48a7-8205-874d3921f688 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:10:38.510772 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-bb209459-777a-48a7-8205-874d3921f688 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:10:38.512608 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-bb209459-777a-48a7-8205-874d3921f688 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:10:38.514090 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-bb209459-777a-48a7-8205-874d3921f688 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] 10.222.0.20 "GET /compute/v2.1/servers/5f84252c-dfc7-4c95-a315-5ac40d997d51" status: 200 len: 1721 microversion: 2.20 time: 0.319218 Jul 01 04:10:38.514743 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 306/624] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Jul 1 04:10:38 2022] GET /compute/v2.1/servers/5f84252c-dfc7-4c95-a315-5ac40d997d51 => generated 1721 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 04:10:39.533326 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-d5481277-4109-47bc-bc29-50d9db4ea42e tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:10:39.534682 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-d5481277-4109-47bc-bc29-50d9db4ea42e tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] [instance: 5f84252c-dfc7-4c95-a315-5ac40d997d51] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:10:39.551584 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-d5481277-4109-47bc-bc29-50d9db4ea42e tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:10:39.551584 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-d5481277-4109-47bc-bc29-50d9db4ea42e tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:10:39.556354 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-d5481277-4109-47bc-bc29-50d9db4ea42e tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:10:39.556973 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-d5481277-4109-47bc-bc29-50d9db4ea42e tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:10:39.755430 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-d5481277-4109-47bc-bc29-50d9db4ea42e tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:10:39.766686 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-d5481277-4109-47bc-bc29-50d9db4ea42e tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:10:39.769458 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-d5481277-4109-47bc-bc29-50d9db4ea42e tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:10:39.770864 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-d5481277-4109-47bc-bc29-50d9db4ea42e tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] 10.222.0.20 "GET /compute/v2.1/servers/5f84252c-dfc7-4c95-a315-5ac40d997d51" status: 200 len: 1721 microversion: 2.20 time: 0.241559 Jul 01 04:10:39.771449 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 319/625] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Jul 1 04:10:39 2022] GET /compute/v2.1/servers/5f84252c-dfc7-4c95-a315-5ac40d997d51 => generated 1721 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 04:10:40.067777 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-63acd421-953c-47e5-91cb-4f97c5680001 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Action: 'create', calling method: .version_select at 0x7f99a0827310>, body: {"keypair": {"name": "tempest-keypair-777883161", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPqUuEqg8MPfqdU5aq+lJzv0xb1B5OQ5r7xXd+dhXwikmMdxVSzVAdce1N4B5w7zg0rE3alYM0AMDVvCD/9RYTAFklQCheiNR+s+nnsgJbEIG6+YcSm1yzrzMK09G32onw=="}} {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 04:10:40.085766 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.quota [None req-63acd421-953c-47e5-91cb-4f97c5680001 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Getting quotas for project f76a684261dd49f68a42a4e157355f37. Resources: {'key_pairs'} {{(pid=118711) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 04:10:40.089892 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.quota [None req-63acd421-953c-47e5-91cb-4f97c5680001 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Getting quotas for user 4ac71714265342098d2487a701a6c364 and project f76a684261dd49f68a42a4e157355f37. Resources: {'key_pairs'} {{(pid=118711) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 04:10:40.211741 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-63acd421-953c-47e5-91cb-4f97c5680001 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.296400 Jul 01 04:10:40.212369 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 307/626] 10.222.0.20 () {60 vars in 1158 bytes} [Fri Jul 1 04:10:39 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 04:10:40.794582 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-66bcee36-e9a5-49ea-a956-74fa3d7720d7 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:10:40.795205 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-66bcee36-e9a5-49ea-a956-74fa3d7720d7 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] [instance: 5f84252c-dfc7-4c95-a315-5ac40d997d51] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:10:40.803257 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-66bcee36-e9a5-49ea-a956-74fa3d7720d7 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:10:40.803722 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-66bcee36-e9a5-49ea-a956-74fa3d7720d7 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:10:40.804530 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-66bcee36-e9a5-49ea-a956-74fa3d7720d7 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:10:40.804974 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-66bcee36-e9a5-49ea-a956-74fa3d7720d7 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:10:40.983691 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-66bcee36-e9a5-49ea-a956-74fa3d7720d7 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:10:40.992908 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-66bcee36-e9a5-49ea-a956-74fa3d7720d7 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:10:40.994340 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-66bcee36-e9a5-49ea-a956-74fa3d7720d7 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:10:40.995827 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-66bcee36-e9a5-49ea-a956-74fa3d7720d7 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] 10.222.0.20 "GET /compute/v2.1/servers/5f84252c-dfc7-4c95-a315-5ac40d997d51" status: 200 len: 1742 microversion: 2.20 time: 0.205670 Jul 01 04:10:40.996398 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 320/627] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Jul 1 04:10:40 2022] GET /compute/v2.1/servers/5f84252c-dfc7-4c95-a315-5ac40d997d51 => generated 1742 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 04:10:42.016369 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-62fe47ab-7b75-48d1-8fa4-5296b4f901f5 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:10:42.018290 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-62fe47ab-7b75-48d1-8fa4-5296b4f901f5 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] [instance: 5f84252c-dfc7-4c95-a315-5ac40d997d51] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:10:42.032053 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-62fe47ab-7b75-48d1-8fa4-5296b4f901f5 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:10:42.032537 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-62fe47ab-7b75-48d1-8fa4-5296b4f901f5 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:10:42.033319 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-62fe47ab-7b75-48d1-8fa4-5296b4f901f5 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:10:42.035592 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-62fe47ab-7b75-48d1-8fa4-5296b4f901f5 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:10:42.241330 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-62fe47ab-7b75-48d1-8fa4-5296b4f901f5 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:10:42.250344 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-62fe47ab-7b75-48d1-8fa4-5296b4f901f5 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:10:42.252058 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-62fe47ab-7b75-48d1-8fa4-5296b4f901f5 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:10:42.253553 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-62fe47ab-7b75-48d1-8fa4-5296b4f901f5 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] 10.222.0.20 "GET /compute/v2.1/servers/5f84252c-dfc7-4c95-a315-5ac40d997d51" status: 200 len: 1737 microversion: 2.20 time: 0.241812 Jul 01 04:10:42.269389 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 308/628] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Jul 1 04:10:42 2022] GET /compute/v2.1/servers/5f84252c-dfc7-4c95-a315-5ac40d997d51 => generated 1737 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 04:10:43.093239 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-45104fef-7071-4505-89f9-214d35acfb5b tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-169420422", "imageRef": "66f9f4ba-339c-4967-8857-d65299a66629", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "72a30e53-10ad-40de-bc68-366d09fc48e5"}], "security_groups": [{"name": "tempest-securitygroup--81519345"}], "key_name": "tempest-keypair-777883161", "user_data": "}} {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 04:10:43.254771 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.network.neutron [None req-45104fef-7071-4505-89f9-214d35acfb5b tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] validate_networks() for [('72a30e53-10ad-40de-bc68-366d09fc48e5', None, None, None, None, None)] {{(pid=118712) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 01 04:10:43.276923 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-34baa932-cf23-4608-8003-63bb644bc736 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:10:43.277704 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-34baa932-cf23-4608-8003-63bb644bc736 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] [instance: 5f84252c-dfc7-4c95-a315-5ac40d997d51] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:10:43.289828 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-34baa932-cf23-4608-8003-63bb644bc736 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:10:43.292290 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-34baa932-cf23-4608-8003-63bb644bc736 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:10:43.297429 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-34baa932-cf23-4608-8003-63bb644bc736 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:10:43.299184 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-34baa932-cf23-4608-8003-63bb644bc736 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:10:43.654792 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-34baa932-cf23-4608-8003-63bb644bc736 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:10:43.669623 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-34baa932-cf23-4608-8003-63bb644bc736 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:10:43.673583 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-34baa932-cf23-4608-8003-63bb644bc736 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:10:43.678257 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-34baa932-cf23-4608-8003-63bb644bc736 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] 10.222.0.20 "GET /compute/v2.1/servers/5f84252c-dfc7-4c95-a315-5ac40d997d51" status: 200 len: 1737 microversion: 2.20 time: 0.405378 Jul 01 04:10:43.693243 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 309/629] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Jul 1 04:10:43 2022] GET /compute/v2.1/servers/5f84252c-dfc7-4c95-a315-5ac40d997d51 => generated 1737 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 04:10:43.824089 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [req-1f096f90-0dcd-4196-b2dd-a7b9fbc0315c req-d061831e-b93c-4f5a-b2c0-667fae093177 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f84252c-dfc7-4c95-a315-5ac40d997d51", "name": "network-vif-plugged", "status": "completed", "tag": "095204ce-045c-45fd-9ec9-e92cab097c71"}]} {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 04:10:43.838265 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [req-1f096f90-0dcd-4196-b2dd-a7b9fbc0315c req-d061831e-b93c-4f5a-b2c0-667fae093177 service nova] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:10:43.842538 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [req-1f096f90-0dcd-4196-b2dd-a7b9fbc0315c req-d061831e-b93c-4f5a-b2c0-667fae093177 service nova] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:10:43.865316 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.compute.server_external_events [req-1f096f90-0dcd-4196-b2dd-a7b9fbc0315c req-d061831e-b93c-4f5a-b2c0-667fae093177 service nova] Creating event network-vif-plugged:095204ce-045c-45fd-9ec9-e92cab097c71 for instance 5f84252c-dfc7-4c95-a315-5ac40d997d51 on hv-cinder-84684 Jul 01 04:10:43.874182 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [req-1f096f90-0dcd-4196-b2dd-a7b9fbc0315c req-d061831e-b93c-4f5a-b2c0-667fae093177 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.179441 Jul 01 04:10:43.875316 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 310/630] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Jul 1 04:10:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 04:10:44.053200 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.virt.hardware [None req-45104fef-7071-4505-89f9-214d35acfb5b tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Flavor limits 0:0:0 {{(pid=118712) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 01 04:10:44.053620 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.virt.hardware [None req-45104fef-7071-4505-89f9-214d35acfb5b tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Image limits 0:0:0 {{(pid=118712) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 01 04:10:44.054091 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.virt.hardware [None req-45104fef-7071-4505-89f9-214d35acfb5b tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Flavor pref 0:0:0 {{(pid=118712) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 01 04:10:44.054496 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.virt.hardware [None req-45104fef-7071-4505-89f9-214d35acfb5b tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Image pref 0:0:0 {{(pid=118712) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 01 04:10:44.054914 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.virt.hardware [None req-45104fef-7071-4505-89f9-214d35acfb5b tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118712) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 01 04:10:44.067243 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-45104fef-7071-4505-89f9-214d35acfb5b tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:10:44.067697 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-45104fef-7071-4505-89f9-214d35acfb5b tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:10:44.068511 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-45104fef-7071-4505-89f9-214d35acfb5b tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:10:44.068952 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-45104fef-7071-4505-89f9-214d35acfb5b tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:10:44.090880 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.quota [None req-45104fef-7071-4505-89f9-214d35acfb5b tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Getting quotas for project f76a684261dd49f68a42a4e157355f37. Resources: {'ram', 'cores', 'instances'} {{(pid=118712) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 04:10:44.098528 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.quota [None req-45104fef-7071-4505-89f9-214d35acfb5b tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Getting quotas for user 4ac71714265342098d2487a701a6c364 and project f76a684261dd49f68a42a4e157355f37. Resources: {'ram', 'cores', 'instances'} {{(pid=118712) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 04:10:44.125964 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-45104fef-7071-4505-89f9-214d35acfb5b tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Going to run 1 instances... {{(pid=118712) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 01 04:10:44.128725 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-45104fef-7071-4505-89f9-214d35acfb5b tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] [instance: 8e620fdf-cea4-431c-abd4-006a5dd37f88] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='66f9f4ba-339c-4967-8857-d65299a66629',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118712) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 01 04:10:44.272379 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-45104fef-7071-4505-89f9-214d35acfb5b tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 1.183655 Jul 01 04:10:44.274720 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 321/631] 10.222.0.20 () {60 vars in 1146 bytes} [Fri Jul 1 04:10:43 2022] POST /compute/v2.1/servers => generated 400 bytes in 1187 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 01 04:10:44.297061 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-119ca32a-ff22-4d77-bdcc-75c2e6cc859e tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:10:44.297773 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-119ca32a-ff22-4d77-bdcc-75c2e6cc859e tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] [instance: 8e620fdf-cea4-431c-abd4-006a5dd37f88] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:10:44.431034 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-119ca32a-ff22-4d77-bdcc-75c2e6cc859e tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac71714265342098d2487a701a6c364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f76a684261dd49f68a42a4e157355f37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:10:44.438560 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-119ca32a-ff22-4d77-bdcc-75c2e6cc859e tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] 10.222.0.20 "GET /compute/v2.1/servers/8e620fdf-cea4-431c-abd4-006a5dd37f88" status: 200 len: 1240 microversion: 2.1 time: 0.154070 Jul 01 04:10:44.439934 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 311/632] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:10:44 2022] GET /compute/v2.1/servers/8e620fdf-cea4-431c-abd4-006a5dd37f88 => generated 1240 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:10:44.700837 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-0c7c52a5-7828-46e5-b51d-77164c64906c tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:10:44.701454 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-0c7c52a5-7828-46e5-b51d-77164c64906c tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] [instance: 5f84252c-dfc7-4c95-a315-5ac40d997d51] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:10:44.716160 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-0c7c52a5-7828-46e5-b51d-77164c64906c tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:10:44.717543 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-0c7c52a5-7828-46e5-b51d-77164c64906c tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:10:44.719419 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-0c7c52a5-7828-46e5-b51d-77164c64906c tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:10:44.726155 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-0c7c52a5-7828-46e5-b51d-77164c64906c tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:10:44.916986 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-0c7c52a5-7828-46e5-b51d-77164c64906c tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:10:44.940936 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-0c7c52a5-7828-46e5-b51d-77164c64906c tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:10:44.940936 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-0c7c52a5-7828-46e5-b51d-77164c64906c tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:10:44.940936 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-0c7c52a5-7828-46e5-b51d-77164c64906c tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] 10.222.0.20 "GET /compute/v2.1/servers/5f84252c-dfc7-4c95-a315-5ac40d997d51" status: 200 len: 1737 microversion: 2.20 time: 0.237041 Jul 01 04:10:44.941322 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 322/633] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Jul 1 04:10:44 2022] GET /compute/v2.1/servers/5f84252c-dfc7-4c95-a315-5ac40d997d51 => generated 1737 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 04:10:45.457418 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-ef460aa2-4051-465d-a884-9105b9fc804e tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:10:45.459186 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-ef460aa2-4051-465d-a884-9105b9fc804e tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] [instance: 8e620fdf-cea4-431c-abd4-006a5dd37f88] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:10:45.546214 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-ef460aa2-4051-465d-a884-9105b9fc804e tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac71714265342098d2487a701a6c364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f76a684261dd49f68a42a4e157355f37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:10:45.558244 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-ef460aa2-4051-465d-a884-9105b9fc804e tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] 10.222.0.20 "GET /compute/v2.1/servers/8e620fdf-cea4-431c-abd4-006a5dd37f88" status: 200 len: 1240 microversion: 2.1 time: 0.104844 Jul 01 04:10:45.558786 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 312/634] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:10:45 2022] GET /compute/v2.1/servers/8e620fdf-cea4-431c-abd4-006a5dd37f88 => generated 1240 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:10:45.954731 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-76a56930-f1d8-4e58-b058-d18688972660 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:10:45.955816 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-76a56930-f1d8-4e58-b058-d18688972660 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] [instance: 5f84252c-dfc7-4c95-a315-5ac40d997d51] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:10:45.963281 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-76a56930-f1d8-4e58-b058-d18688972660 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:10:45.963750 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-76a56930-f1d8-4e58-b058-d18688972660 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:10:45.964567 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-76a56930-f1d8-4e58-b058-d18688972660 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:10:45.965020 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-76a56930-f1d8-4e58-b058-d18688972660 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:10:46.123585 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-76a56930-f1d8-4e58-b058-d18688972660 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:10:46.130492 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-76a56930-f1d8-4e58-b058-d18688972660 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:10:46.132053 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-76a56930-f1d8-4e58-b058-d18688972660 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:10:46.133218 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-76a56930-f1d8-4e58-b058-d18688972660 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] 10.222.0.20 "GET /compute/v2.1/servers/5f84252c-dfc7-4c95-a315-5ac40d997d51" status: 200 len: 1737 microversion: 2.20 time: 0.183473 Jul 01 04:10:46.133776 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 323/635] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Jul 1 04:10:45 2022] GET /compute/v2.1/servers/5f84252c-dfc7-4c95-a315-5ac40d997d51 => generated 1737 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 04:10:46.580026 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-b94e6fa4-9fcf-43d0-80d1-6f7fc6012d41 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:10:46.582102 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-b94e6fa4-9fcf-43d0-80d1-6f7fc6012d41 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] [instance: 8e620fdf-cea4-431c-abd4-006a5dd37f88] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:10:46.597280 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-b94e6fa4-9fcf-43d0-80d1-6f7fc6012d41 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:10:46.598241 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-b94e6fa4-9fcf-43d0-80d1-6f7fc6012d41 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:10:46.599143 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-b94e6fa4-9fcf-43d0-80d1-6f7fc6012d41 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:10:46.599809 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-b94e6fa4-9fcf-43d0-80d1-6f7fc6012d41 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:10:46.690497 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-b94e6fa4-9fcf-43d0-80d1-6f7fc6012d41 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac71714265342098d2487a701a6c364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f76a684261dd49f68a42a4e157355f37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:10:46.701494 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-b94e6fa4-9fcf-43d0-80d1-6f7fc6012d41 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] 10.222.0.20 "GET /compute/v2.1/servers/8e620fdf-cea4-431c-abd4-006a5dd37f88" status: 200 len: 1236 microversion: 2.1 time: 0.128825 Jul 01 04:10:46.702649 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 313/636] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:10:46 2022] GET /compute/v2.1/servers/8e620fdf-cea4-431c-abd4-006a5dd37f88 => generated 1236 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:10:47.154356 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-5189364e-124e-4aae-a297-6251f7c695fa tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:10:47.154971 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-5189364e-124e-4aae-a297-6251f7c695fa tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] [instance: 5f84252c-dfc7-4c95-a315-5ac40d997d51] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:10:47.162906 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-5189364e-124e-4aae-a297-6251f7c695fa tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:10:47.163391 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-5189364e-124e-4aae-a297-6251f7c695fa tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:10:47.167271 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-5189364e-124e-4aae-a297-6251f7c695fa tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:10:47.168586 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-5189364e-124e-4aae-a297-6251f7c695fa tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:10:47.362278 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-5189364e-124e-4aae-a297-6251f7c695fa tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:10:47.372994 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-5189364e-124e-4aae-a297-6251f7c695fa tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:10:47.374545 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-5189364e-124e-4aae-a297-6251f7c695fa tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:10:47.376196 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-5189364e-124e-4aae-a297-6251f7c695fa tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] 10.222.0.20 "GET /compute/v2.1/servers/5f84252c-dfc7-4c95-a315-5ac40d997d51" status: 200 len: 1737 microversion: 2.20 time: 0.225891 Jul 01 04:10:47.389014 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 324/637] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Jul 1 04:10:47 2022] GET /compute/v2.1/servers/5f84252c-dfc7-4c95-a315-5ac40d997d51 => generated 1737 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 04:10:47.723376 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-ba371e4b-7510-406f-bdb0-97e5a9d203ea tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:10:47.724885 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-ba371e4b-7510-406f-bdb0-97e5a9d203ea tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] [instance: 8e620fdf-cea4-431c-abd4-006a5dd37f88] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:10:47.736839 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-ba371e4b-7510-406f-bdb0-97e5a9d203ea tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:10:47.737725 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-ba371e4b-7510-406f-bdb0-97e5a9d203ea tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:10:47.739272 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-ba371e4b-7510-406f-bdb0-97e5a9d203ea tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:10:47.740005 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-ba371e4b-7510-406f-bdb0-97e5a9d203ea tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:10:47.826572 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-ba371e4b-7510-406f-bdb0-97e5a9d203ea tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac71714265342098d2487a701a6c364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f76a684261dd49f68a42a4e157355f37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:10:47.835904 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-ba371e4b-7510-406f-bdb0-97e5a9d203ea tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] 10.222.0.20 "GET /compute/v2.1/servers/8e620fdf-cea4-431c-abd4-006a5dd37f88" status: 200 len: 1300 microversion: 2.1 time: 0.118166 Jul 01 04:10:47.836860 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 314/638] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:10:47 2022] GET /compute/v2.1/servers/8e620fdf-cea4-431c-abd4-006a5dd37f88 => generated 1300 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:10:48.398699 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-10bc16e5-161d-48c3-8595-1b5410a41245 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:10:48.401747 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-10bc16e5-161d-48c3-8595-1b5410a41245 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] [instance: 5f84252c-dfc7-4c95-a315-5ac40d997d51] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:10:48.410298 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-10bc16e5-161d-48c3-8595-1b5410a41245 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:10:48.411689 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-10bc16e5-161d-48c3-8595-1b5410a41245 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:10:48.412788 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-10bc16e5-161d-48c3-8595-1b5410a41245 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:10:48.413474 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-10bc16e5-161d-48c3-8595-1b5410a41245 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:10:48.609423 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-10bc16e5-161d-48c3-8595-1b5410a41245 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:10:48.622980 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-10bc16e5-161d-48c3-8595-1b5410a41245 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:10:48.625926 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-10bc16e5-161d-48c3-8595-1b5410a41245 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:10:48.627279 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-10bc16e5-161d-48c3-8595-1b5410a41245 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] 10.222.0.20 "GET /compute/v2.1/servers/5f84252c-dfc7-4c95-a315-5ac40d997d51" status: 200 len: 1737 microversion: 2.20 time: 0.234701 Jul 01 04:10:48.662296 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 325/639] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Jul 1 04:10:48 2022] GET /compute/v2.1/servers/5f84252c-dfc7-4c95-a315-5ac40d997d51 => generated 1737 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 04:10:48.856565 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-51ba67df-bad0-4493-a7f3-5f0c69437933 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:10:48.858124 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-51ba67df-bad0-4493-a7f3-5f0c69437933 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] [instance: 8e620fdf-cea4-431c-abd4-006a5dd37f88] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:10:48.869156 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-51ba67df-bad0-4493-a7f3-5f0c69437933 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:10:48.870036 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-51ba67df-bad0-4493-a7f3-5f0c69437933 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:10:48.871063 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-51ba67df-bad0-4493-a7f3-5f0c69437933 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:10:48.872433 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-51ba67df-bad0-4493-a7f3-5f0c69437933 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:10:49.140318 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-51ba67df-bad0-4493-a7f3-5f0c69437933 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac71714265342098d2487a701a6c364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f76a684261dd49f68a42a4e157355f37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:10:49.151326 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-51ba67df-bad0-4493-a7f3-5f0c69437933 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] 10.222.0.20 "GET /compute/v2.1/servers/8e620fdf-cea4-431c-abd4-006a5dd37f88" status: 200 len: 1364 microversion: 2.1 time: 0.300931 Jul 01 04:10:49.152081 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 315/640] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:10:48 2022] GET /compute/v2.1/servers/8e620fdf-cea4-431c-abd4-006a5dd37f88 => generated 1364 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:10:49.665496 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-a34302f8-7724-4082-8ec1-628806f06f25 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:10:49.666407 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-a34302f8-7724-4082-8ec1-628806f06f25 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] [instance: 5f84252c-dfc7-4c95-a315-5ac40d997d51] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:10:49.674575 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-a34302f8-7724-4082-8ec1-628806f06f25 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:10:49.675389 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-a34302f8-7724-4082-8ec1-628806f06f25 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:10:49.676261 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-a34302f8-7724-4082-8ec1-628806f06f25 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:10:49.676750 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-a34302f8-7724-4082-8ec1-628806f06f25 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:10:49.841546 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-a34302f8-7724-4082-8ec1-628806f06f25 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:10:49.850679 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-a34302f8-7724-4082-8ec1-628806f06f25 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:10:49.852230 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-a34302f8-7724-4082-8ec1-628806f06f25 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:10:49.853477 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-a34302f8-7724-4082-8ec1-628806f06f25 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] 10.222.0.20 "GET /compute/v2.1/servers/5f84252c-dfc7-4c95-a315-5ac40d997d51" status: 200 len: 1737 microversion: 2.20 time: 0.192224 Jul 01 04:10:49.854033 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 326/641] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Jul 1 04:10:49 2022] GET /compute/v2.1/servers/5f84252c-dfc7-4c95-a315-5ac40d997d51 => generated 1737 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 04:10:50.049587 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [req-bedac67a-61f7-4221-9774-845ef967f1f4 req-6e6ca7a1-4356-4715-8699-a271e1ccd2f9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8e620fdf-cea4-431c-abd4-006a5dd37f88", "tag": "ce5fe4b2-9dff-4c4f-8741-8db0d584da49"}]} {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 04:10:50.064505 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [req-bedac67a-61f7-4221-9774-845ef967f1f4 req-6e6ca7a1-4356-4715-8699-a271e1ccd2f9 service nova] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:10:50.064957 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [req-bedac67a-61f7-4221-9774-845ef967f1f4 req-6e6ca7a1-4356-4715-8699-a271e1ccd2f9 service nova] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:10:50.085257 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.compute.server_external_events [req-bedac67a-61f7-4221-9774-845ef967f1f4 req-6e6ca7a1-4356-4715-8699-a271e1ccd2f9 service nova] Creating event network-changed:ce5fe4b2-9dff-4c4f-8741-8db0d584da49 for instance 8e620fdf-cea4-431c-abd4-006a5dd37f88 on hv-cinder-84684 Jul 01 04:10:50.091978 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [req-bedac67a-61f7-4221-9774-845ef967f1f4 req-6e6ca7a1-4356-4715-8699-a271e1ccd2f9 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046175 Jul 01 04:10:50.093228 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 316/642] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Jul 1 04:10:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 04:10:50.170227 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-fa7f0f3a-4155-4daf-86e4-28ed151dd809 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:10:50.170871 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-fa7f0f3a-4155-4daf-86e4-28ed151dd809 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] [instance: 8e620fdf-cea4-431c-abd4-006a5dd37f88] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:10:50.179053 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-fa7f0f3a-4155-4daf-86e4-28ed151dd809 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:10:50.179545 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-fa7f0f3a-4155-4daf-86e4-28ed151dd809 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:10:50.180340 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-fa7f0f3a-4155-4daf-86e4-28ed151dd809 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:10:50.180790 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-fa7f0f3a-4155-4daf-86e4-28ed151dd809 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:10:50.391800 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-fa7f0f3a-4155-4daf-86e4-28ed151dd809 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac71714265342098d2487a701a6c364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f76a684261dd49f68a42a4e157355f37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:10:50.400753 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-fa7f0f3a-4155-4daf-86e4-28ed151dd809 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] 10.222.0.20 "GET /compute/v2.1/servers/8e620fdf-cea4-431c-abd4-006a5dd37f88" status: 200 len: 1364 microversion: 2.1 time: 0.235278 Jul 01 04:10:50.401661 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 327/643] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:10:50 2022] GET /compute/v2.1/servers/8e620fdf-cea4-431c-abd4-006a5dd37f88 => generated 1364 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:10:50.874095 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-0dde7c4e-294c-4dc9-8ba6-237f7200530a tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:10:50.875284 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-0dde7c4e-294c-4dc9-8ba6-237f7200530a tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] [instance: 5f84252c-dfc7-4c95-a315-5ac40d997d51] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:10:50.882260 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-0dde7c4e-294c-4dc9-8ba6-237f7200530a tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:10:50.882880 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-0dde7c4e-294c-4dc9-8ba6-237f7200530a tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:10:50.883690 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-0dde7c4e-294c-4dc9-8ba6-237f7200530a tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:10:50.884378 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-0dde7c4e-294c-4dc9-8ba6-237f7200530a tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:10:51.082918 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-0dde7c4e-294c-4dc9-8ba6-237f7200530a tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:10:51.093330 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-0dde7c4e-294c-4dc9-8ba6-237f7200530a tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:10:51.095418 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-0dde7c4e-294c-4dc9-8ba6-237f7200530a tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:10:51.096614 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-0dde7c4e-294c-4dc9-8ba6-237f7200530a tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] 10.222.0.20 "GET /compute/v2.1/servers/5f84252c-dfc7-4c95-a315-5ac40d997d51" status: 200 len: 1737 microversion: 2.20 time: 0.228536 Jul 01 04:10:51.097173 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 317/644] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Jul 1 04:10:50 2022] GET /compute/v2.1/servers/5f84252c-dfc7-4c95-a315-5ac40d997d51 => generated 1737 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 04:10:51.421660 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-9c44783a-e6d9-4691-b96d-114d92c3215a tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:10:51.423682 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-9c44783a-e6d9-4691-b96d-114d92c3215a tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] [instance: 8e620fdf-cea4-431c-abd4-006a5dd37f88] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:10:51.432298 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-9c44783a-e6d9-4691-b96d-114d92c3215a tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:10:51.433126 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-9c44783a-e6d9-4691-b96d-114d92c3215a tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:10:51.434022 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-9c44783a-e6d9-4691-b96d-114d92c3215a tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:10:51.434458 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-9c44783a-e6d9-4691-b96d-114d92c3215a tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:10:51.586561 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-9c44783a-e6d9-4691-b96d-114d92c3215a tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac71714265342098d2487a701a6c364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f76a684261dd49f68a42a4e157355f37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:10:51.595190 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-9c44783a-e6d9-4691-b96d-114d92c3215a tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] 10.222.0.20 "GET /compute/v2.1/servers/8e620fdf-cea4-431c-abd4-006a5dd37f88" status: 200 len: 1364 microversion: 2.1 time: 0.180400 Jul 01 04:10:51.595782 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 328/645] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:10:51 2022] GET /compute/v2.1/servers/8e620fdf-cea4-431c-abd4-006a5dd37f88 => generated 1364 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 04:10:52.116195 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-3288f4b7-5094-4102-8863-71df2c4ee57a tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:10:52.117211 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-3288f4b7-5094-4102-8863-71df2c4ee57a tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] [instance: 5f84252c-dfc7-4c95-a315-5ac40d997d51] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:10:52.125004 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-3288f4b7-5094-4102-8863-71df2c4ee57a tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:10:52.126401 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-3288f4b7-5094-4102-8863-71df2c4ee57a tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:10:52.127025 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-3288f4b7-5094-4102-8863-71df2c4ee57a tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:10:52.127611 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-3288f4b7-5094-4102-8863-71df2c4ee57a tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:10:52.281890 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-3288f4b7-5094-4102-8863-71df2c4ee57a tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:10:52.295609 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-3288f4b7-5094-4102-8863-71df2c4ee57a tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:10:52.298766 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-3288f4b7-5094-4102-8863-71df2c4ee57a tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:10:52.300060 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-3288f4b7-5094-4102-8863-71df2c4ee57a tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] 10.222.0.20 "GET /compute/v2.1/servers/5f84252c-dfc7-4c95-a315-5ac40d997d51" status: 200 len: 1737 microversion: 2.20 time: 0.188014 Jul 01 04:10:52.303261 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 318/646] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Jul 1 04:10:52 2022] GET /compute/v2.1/servers/5f84252c-dfc7-4c95-a315-5ac40d997d51 => generated 1737 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 04:10:52.612965 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-6f585859-6dc8-49be-a592-a0afeefe24f7 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:10:52.614223 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-6f585859-6dc8-49be-a592-a0afeefe24f7 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] [instance: 8e620fdf-cea4-431c-abd4-006a5dd37f88] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:10:52.621108 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-6f585859-6dc8-49be-a592-a0afeefe24f7 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:10:52.623083 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-6f585859-6dc8-49be-a592-a0afeefe24f7 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:10:52.624102 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-6f585859-6dc8-49be-a592-a0afeefe24f7 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:10:52.624765 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-6f585859-6dc8-49be-a592-a0afeefe24f7 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:10:52.778838 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-6f585859-6dc8-49be-a592-a0afeefe24f7 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac71714265342098d2487a701a6c364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f76a684261dd49f68a42a4e157355f37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:10:52.786273 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-6f585859-6dc8-49be-a592-a0afeefe24f7 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] 10.222.0.20 "GET /compute/v2.1/servers/8e620fdf-cea4-431c-abd4-006a5dd37f88" status: 200 len: 1364 microversion: 2.1 time: 0.177596 Jul 01 04:10:52.787146 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 329/647] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:10:52 2022] GET /compute/v2.1/servers/8e620fdf-cea4-431c-abd4-006a5dd37f88 => generated 1364 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:10:53.320646 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-638370f1-f52a-41ac-bb92-19507f284b59 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:10:53.321369 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-638370f1-f52a-41ac-bb92-19507f284b59 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] [instance: 5f84252c-dfc7-4c95-a315-5ac40d997d51] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:10:53.332451 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-638370f1-f52a-41ac-bb92-19507f284b59 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:10:53.333272 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-638370f1-f52a-41ac-bb92-19507f284b59 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:10:53.334612 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-638370f1-f52a-41ac-bb92-19507f284b59 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:10:53.335531 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-638370f1-f52a-41ac-bb92-19507f284b59 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:10:53.365226 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG dbcounter [-] [118711] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:10:53.514380 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-638370f1-f52a-41ac-bb92-19507f284b59 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:10:53.525110 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-638370f1-f52a-41ac-bb92-19507f284b59 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:10:53.527338 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-638370f1-f52a-41ac-bb92-19507f284b59 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:10:53.529848 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-638370f1-f52a-41ac-bb92-19507f284b59 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] 10.222.0.20 "GET /compute/v2.1/servers/5f84252c-dfc7-4c95-a315-5ac40d997d51" status: 200 len: 1737 microversion: 2.20 time: 0.215461 Jul 01 04:10:53.530565 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 319/648] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Jul 1 04:10:53 2022] GET /compute/v2.1/servers/5f84252c-dfc7-4c95-a315-5ac40d997d51 => generated 1737 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 04:10:53.809179 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-aa598722-0c44-48f7-8b14-4c781d4f6a14 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:10:53.811354 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-aa598722-0c44-48f7-8b14-4c781d4f6a14 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] [instance: 8e620fdf-cea4-431c-abd4-006a5dd37f88] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:10:53.819500 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-aa598722-0c44-48f7-8b14-4c781d4f6a14 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:10:53.827401 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-aa598722-0c44-48f7-8b14-4c781d4f6a14 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:10:53.827401 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-aa598722-0c44-48f7-8b14-4c781d4f6a14 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:10:53.827401 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-aa598722-0c44-48f7-8b14-4c781d4f6a14 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:10:53.963440 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-aa598722-0c44-48f7-8b14-4c781d4f6a14 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac71714265342098d2487a701a6c364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f76a684261dd49f68a42a4e157355f37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:10:53.971486 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-aa598722-0c44-48f7-8b14-4c781d4f6a14 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] 10.222.0.20 "GET /compute/v2.1/servers/8e620fdf-cea4-431c-abd4-006a5dd37f88" status: 200 len: 1364 microversion: 2.1 time: 0.166344 Jul 01 04:10:53.972054 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 330/649] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:10:53 2022] GET /compute/v2.1/servers/8e620fdf-cea4-431c-abd4-006a5dd37f88 => generated 1364 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:10:54.548646 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-4471632d-f2d6-42ee-9c8b-87d5d7a022ce tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:10:54.549361 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-4471632d-f2d6-42ee-9c8b-87d5d7a022ce tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] [instance: 5f84252c-dfc7-4c95-a315-5ac40d997d51] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:10:54.556299 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-4471632d-f2d6-42ee-9c8b-87d5d7a022ce tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:10:54.556776 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-4471632d-f2d6-42ee-9c8b-87d5d7a022ce tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:10:54.557547 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-4471632d-f2d6-42ee-9c8b-87d5d7a022ce tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:10:54.557987 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-4471632d-f2d6-42ee-9c8b-87d5d7a022ce tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:10:54.689395 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-4471632d-f2d6-42ee-9c8b-87d5d7a022ce tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:10:54.697820 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-4471632d-f2d6-42ee-9c8b-87d5d7a022ce tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:10:54.699357 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-4471632d-f2d6-42ee-9c8b-87d5d7a022ce tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:10:54.700521 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-4471632d-f2d6-42ee-9c8b-87d5d7a022ce tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] 10.222.0.20 "GET /compute/v2.1/servers/5f84252c-dfc7-4c95-a315-5ac40d997d51" status: 200 len: 1737 microversion: 2.20 time: 0.155877 Jul 01 04:10:54.701093 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 320/650] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Jul 1 04:10:54 2022] GET /compute/v2.1/servers/5f84252c-dfc7-4c95-a315-5ac40d997d51 => generated 1737 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 04:10:54.988525 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-d437dc94-37b5-478d-97ee-a78356be6a06 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:10:54.989177 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-d437dc94-37b5-478d-97ee-a78356be6a06 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] [instance: 8e620fdf-cea4-431c-abd4-006a5dd37f88] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:10:54.991010 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG dbcounter [-] [118712] Writing DB stats nova_cell0:SELECT=2 {{(pid=118712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:10:54.991889 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG dbcounter [-] [118712] Writing DB stats nova_cell0:SELECT=6 {{(pid=118712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:10:54.997100 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-d437dc94-37b5-478d-97ee-a78356be6a06 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:10:54.997563 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-d437dc94-37b5-478d-97ee-a78356be6a06 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:10:54.998371 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-d437dc94-37b5-478d-97ee-a78356be6a06 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:10:54.998824 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-d437dc94-37b5-478d-97ee-a78356be6a06 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:10:55.138285 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-d437dc94-37b5-478d-97ee-a78356be6a06 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac71714265342098d2487a701a6c364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f76a684261dd49f68a42a4e157355f37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:10:55.146045 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-d437dc94-37b5-478d-97ee-a78356be6a06 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] 10.222.0.20 "GET /compute/v2.1/servers/8e620fdf-cea4-431c-abd4-006a5dd37f88" status: 200 len: 1364 microversion: 2.1 time: 0.161346 Jul 01 04:10:55.146623 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 331/651] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:10:54 2022] GET /compute/v2.1/servers/8e620fdf-cea4-431c-abd4-006a5dd37f88 => generated 1364 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:10:55.394650 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [req-43589b40-50ef-4a63-aba6-76d4f92083af req-192bc1ad-d18f-4b46-8dc6-b62f9706e72a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e620fdf-cea4-431c-abd4-006a5dd37f88", "name": "network-vif-plugged", "status": "completed", "tag": "ce5fe4b2-9dff-4c4f-8741-8db0d584da49"}]} {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 04:10:55.405451 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [req-43589b40-50ef-4a63-aba6-76d4f92083af req-192bc1ad-d18f-4b46-8dc6-b62f9706e72a service nova] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:10:55.405894 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [req-43589b40-50ef-4a63-aba6-76d4f92083af req-192bc1ad-d18f-4b46-8dc6-b62f9706e72a service nova] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:10:55.417166 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.compute.server_external_events [req-43589b40-50ef-4a63-aba6-76d4f92083af req-192bc1ad-d18f-4b46-8dc6-b62f9706e72a service nova] Creating event network-vif-plugged:ce5fe4b2-9dff-4c4f-8741-8db0d584da49 for instance 8e620fdf-cea4-431c-abd4-006a5dd37f88 on hv-cinder-84684 Jul 01 04:10:55.422076 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [req-43589b40-50ef-4a63-aba6-76d4f92083af req-192bc1ad-d18f-4b46-8dc6-b62f9706e72a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032361 Jul 01 04:10:55.422604 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 321/652] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Jul 1 04:10:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 04:10:55.718298 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-d453b09c-80a9-44f3-8fc1-e61287a5868a tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:10:55.718907 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-d453b09c-80a9-44f3-8fc1-e61287a5868a tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] [instance: 5f84252c-dfc7-4c95-a315-5ac40d997d51] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:10:55.725109 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-d453b09c-80a9-44f3-8fc1-e61287a5868a tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:10:55.725556 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-d453b09c-80a9-44f3-8fc1-e61287a5868a tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:10:55.726329 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-d453b09c-80a9-44f3-8fc1-e61287a5868a tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:10:55.726764 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-d453b09c-80a9-44f3-8fc1-e61287a5868a tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:10:55.863852 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-d453b09c-80a9-44f3-8fc1-e61287a5868a tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:10:55.872412 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-d453b09c-80a9-44f3-8fc1-e61287a5868a tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:10:55.873904 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-d453b09c-80a9-44f3-8fc1-e61287a5868a tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:10:55.875202 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-d453b09c-80a9-44f3-8fc1-e61287a5868a tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] 10.222.0.20 "GET /compute/v2.1/servers/5f84252c-dfc7-4c95-a315-5ac40d997d51" status: 200 len: 1719 microversion: 2.20 time: 0.160973 Jul 01 04:10:55.875785 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 332/653] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Jul 1 04:10:55 2022] GET /compute/v2.1/servers/5f84252c-dfc7-4c95-a315-5ac40d997d51 => generated 1719 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 04:10:56.161575 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG dbcounter [-] [118711] Writing DB stats nova_cell0:SELECT=8 {{(pid=118711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:10:56.165747 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-cfe3e55a-d69c-4fe5-87eb-c90025d2dfa4 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:10:56.166448 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-cfe3e55a-d69c-4fe5-87eb-c90025d2dfa4 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] [instance: 8e620fdf-cea4-431c-abd4-006a5dd37f88] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:10:56.173499 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-cfe3e55a-d69c-4fe5-87eb-c90025d2dfa4 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:10:56.174005 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-cfe3e55a-d69c-4fe5-87eb-c90025d2dfa4 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:10:56.174776 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-cfe3e55a-d69c-4fe5-87eb-c90025d2dfa4 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:10:56.175256 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-cfe3e55a-d69c-4fe5-87eb-c90025d2dfa4 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:10:56.313925 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-cfe3e55a-d69c-4fe5-87eb-c90025d2dfa4 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac71714265342098d2487a701a6c364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f76a684261dd49f68a42a4e157355f37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:10:56.322229 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-cfe3e55a-d69c-4fe5-87eb-c90025d2dfa4 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] 10.222.0.20 "GET /compute/v2.1/servers/8e620fdf-cea4-431c-abd4-006a5dd37f88" status: 200 len: 1364 microversion: 2.1 time: 0.162047 Jul 01 04:10:56.322829 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 322/654] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:10:56 2022] GET /compute/v2.1/servers/8e620fdf-cea4-431c-abd4-006a5dd37f88 => generated 1364 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:10:56.895302 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-3c0747ae-f7e2-4678-8dd3-4019ced2040b tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:10:56.895940 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-3c0747ae-f7e2-4678-8dd3-4019ced2040b tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] [instance: 5f84252c-dfc7-4c95-a315-5ac40d997d51] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:10:56.902722 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-3c0747ae-f7e2-4678-8dd3-4019ced2040b tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:10:56.903748 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-3c0747ae-f7e2-4678-8dd3-4019ced2040b tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:10:56.904580 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-3c0747ae-f7e2-4678-8dd3-4019ced2040b tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:10:56.905021 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-3c0747ae-f7e2-4678-8dd3-4019ced2040b tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:10:57.051686 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-3c0747ae-f7e2-4678-8dd3-4019ced2040b tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:10:57.060815 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-3c0747ae-f7e2-4678-8dd3-4019ced2040b tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:10:57.062723 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-3c0747ae-f7e2-4678-8dd3-4019ced2040b tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:10:57.063940 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-3c0747ae-f7e2-4678-8dd3-4019ced2040b tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] 10.222.0.20 "GET /compute/v2.1/servers/5f84252c-dfc7-4c95-a315-5ac40d997d51" status: 200 len: 1719 microversion: 2.20 time: 0.173255 Jul 01 04:10:57.064576 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 333/655] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Jul 1 04:10:56 2022] GET /compute/v2.1/servers/5f84252c-dfc7-4c95-a315-5ac40d997d51 => generated 1719 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 04:10:57.339528 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-245d69f5-e4a2-4c1e-a92a-0daf5aa35197 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:10:57.340244 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-245d69f5-e4a2-4c1e-a92a-0daf5aa35197 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] [instance: 8e620fdf-cea4-431c-abd4-006a5dd37f88] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:10:57.347044 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-245d69f5-e4a2-4c1e-a92a-0daf5aa35197 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:10:57.347537 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-245d69f5-e4a2-4c1e-a92a-0daf5aa35197 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:10:57.348326 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-245d69f5-e4a2-4c1e-a92a-0daf5aa35197 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:10:57.348771 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-245d69f5-e4a2-4c1e-a92a-0daf5aa35197 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:10:57.509578 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-245d69f5-e4a2-4c1e-a92a-0daf5aa35197 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac71714265342098d2487a701a6c364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f76a684261dd49f68a42a4e157355f37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:10:57.520909 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-245d69f5-e4a2-4c1e-a92a-0daf5aa35197 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] 10.222.0.20 "GET /compute/v2.1/servers/8e620fdf-cea4-431c-abd4-006a5dd37f88" status: 200 len: 1364 microversion: 2.1 time: 0.185175 Jul 01 04:10:57.521578 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 323/656] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:10:57 2022] GET /compute/v2.1/servers/8e620fdf-cea4-431c-abd4-006a5dd37f88 => generated 1364 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 04:10:58.083952 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-c8886807-d071-4b65-84bd-030b2d2465bd tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:10:58.084549 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-c8886807-d071-4b65-84bd-030b2d2465bd tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] [instance: 5f84252c-dfc7-4c95-a315-5ac40d997d51] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:10:58.091617 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-c8886807-d071-4b65-84bd-030b2d2465bd tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:10:58.092072 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-c8886807-d071-4b65-84bd-030b2d2465bd tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:10:58.092838 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-c8886807-d071-4b65-84bd-030b2d2465bd tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:10:58.093276 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-c8886807-d071-4b65-84bd-030b2d2465bd tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:10:58.223001 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-c8886807-d071-4b65-84bd-030b2d2465bd tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:10:58.231487 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-c8886807-d071-4b65-84bd-030b2d2465bd tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:10:58.233011 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-c8886807-d071-4b65-84bd-030b2d2465bd tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:10:58.234180 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-c8886807-d071-4b65-84bd-030b2d2465bd tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] 10.222.0.20 "GET /compute/v2.1/servers/5f84252c-dfc7-4c95-a315-5ac40d997d51" status: 200 len: 1722 microversion: 2.20 time: 0.154260 Jul 01 04:10:58.234745 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 334/657] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Jul 1 04:10:58 2022] GET /compute/v2.1/servers/5f84252c-dfc7-4c95-a315-5ac40d997d51 => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 04:10:58.251712 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-dc4fbe30-62fe-4935-9922-285bfbc16fe2 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6dc25715-337c-433e-8430-fe2e2d29fda3"}} {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 04:10:58.252791 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-dc4fbe30-62fe-4935-9922-285bfbc16fe2 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] [instance: 5f84252c-dfc7-4c95-a315-5ac40d997d51] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:10:58.258896 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-dc4fbe30-62fe-4935-9922-285bfbc16fe2 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:10:58.259396 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-dc4fbe30-62fe-4935-9922-285bfbc16fe2 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:10:58.260166 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-dc4fbe30-62fe-4935-9922-285bfbc16fe2 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:10:58.260614 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-dc4fbe30-62fe-4935-9922-285bfbc16fe2 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:10:58.538155 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-c6e167a6-5a74-4cde-b045-0a69e3b98bee tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:10:58.538824 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-c6e167a6-5a74-4cde-b045-0a69e3b98bee tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] [instance: 8e620fdf-cea4-431c-abd4-006a5dd37f88] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:10:58.545547 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-c6e167a6-5a74-4cde-b045-0a69e3b98bee tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:10:58.545999 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-c6e167a6-5a74-4cde-b045-0a69e3b98bee tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:10:58.546778 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-c6e167a6-5a74-4cde-b045-0a69e3b98bee tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:10:58.547278 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-c6e167a6-5a74-4cde-b045-0a69e3b98bee tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:10:58.563646 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG dbcounter [-] [118712] Writing DB stats nova_cell1:SELECT=100 {{(pid=118712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:10:58.692124 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-c6e167a6-5a74-4cde-b045-0a69e3b98bee tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac71714265342098d2487a701a6c364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f76a684261dd49f68a42a4e157355f37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:10:58.700489 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-c6e167a6-5a74-4cde-b045-0a69e3b98bee tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] 10.222.0.20 "GET /compute/v2.1/servers/8e620fdf-cea4-431c-abd4-006a5dd37f88" status: 200 len: 1364 microversion: 2.1 time: 0.165657 Jul 01 04:10:58.701075 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 335/658] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:10:58 2022] GET /compute/v2.1/servers/8e620fdf-cea4-431c-abd4-006a5dd37f88 => generated 1364 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 04:10:59.335575 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [req-7e42be7b-7ce0-4f39-a178-77b90ffa2195 req-2aab2423-7d66-4018-990b-1a6041f04a39 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f84252c-dfc7-4c95-a315-5ac40d997d51", "name": "network-vif-unplugged", "status": "completed", "tag": "095204ce-045c-45fd-9ec9-e92cab097c71"}]} {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 04:10:59.344923 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [req-7e42be7b-7ce0-4f39-a178-77b90ffa2195 req-2aab2423-7d66-4018-990b-1a6041f04a39 service nova] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:10:59.345257 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [req-7e42be7b-7ce0-4f39-a178-77b90ffa2195 req-2aab2423-7d66-4018-990b-1a6041f04a39 service nova] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:10:59.357638 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.compute.server_external_events [req-7e42be7b-7ce0-4f39-a178-77b90ffa2195 req-2aab2423-7d66-4018-990b-1a6041f04a39 service nova] Unable to find a host for instance 5f84252c-dfc7-4c95-a315-5ac40d997d51. Dropping event network-vif-unplugged {{(pid=118712) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jul 01 04:10:59.358522 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [req-7e42be7b-7ce0-4f39-a178-77b90ffa2195 req-2aab2423-7d66-4018-990b-1a6041f04a39 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.027042 Jul 01 04:10:59.359114 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 336/659] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Jul 1 04:10:59 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 28 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Jul 01 04:10:59.506267 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-dc4fbe30-62fe-4935-9922-285bfbc16fe2 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] 10.222.0.20 "POST /compute/v2.1/servers/5f84252c-dfc7-4c95-a315-5ac40d997d51/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.258453 Jul 01 04:10:59.506922 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 324/660] 10.222.0.20 () {62 vars in 1363 bytes} [Fri Jul 1 04:10:58 2022] POST /compute/v2.1/servers/5f84252c-dfc7-4c95-a315-5ac40d997d51/os-volume_attachments => generated 188 bytes in 1260 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 01 04:10:59.631398 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-fe175479-559d-40eb-b0f9-473071fd5d98 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:10:59.631900 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-fe175479-559d-40eb-b0f9-473071fd5d98 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] [instance: 5f84252c-dfc7-4c95-a315-5ac40d997d51] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:10:59.638071 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-fe175479-559d-40eb-b0f9-473071fd5d98 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:10:59.638529 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-fe175479-559d-40eb-b0f9-473071fd5d98 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:10:59.639344 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-fe175479-559d-40eb-b0f9-473071fd5d98 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:10:59.639827 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-fe175479-559d-40eb-b0f9-473071fd5d98 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:10:59.721433 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-2602a6ce-c4d2-4e32-8106-6d3f081cc909 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:10:59.721433 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-2602a6ce-c4d2-4e32-8106-6d3f081cc909 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] [instance: 8e620fdf-cea4-431c-abd4-006a5dd37f88] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:10:59.725392 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-2602a6ce-c4d2-4e32-8106-6d3f081cc909 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:10:59.725914 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-2602a6ce-c4d2-4e32-8106-6d3f081cc909 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:10:59.726632 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-2602a6ce-c4d2-4e32-8106-6d3f081cc909 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:10:59.727210 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-2602a6ce-c4d2-4e32-8106-6d3f081cc909 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:10:59.860954 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-2602a6ce-c4d2-4e32-8106-6d3f081cc909 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac71714265342098d2487a701a6c364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f76a684261dd49f68a42a4e157355f37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:10:59.868410 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-2602a6ce-c4d2-4e32-8106-6d3f081cc909 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] 10.222.0.20 "GET /compute/v2.1/servers/8e620fdf-cea4-431c-abd4-006a5dd37f88" status: 200 len: 1555 microversion: 2.1 time: 0.154793 Jul 01 04:10:59.868972 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 325/661] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:10:59 2022] GET /compute/v2.1/servers/8e620fdf-cea4-431c-abd4-006a5dd37f88 => generated 1555 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 04:10:59.884567 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-09cdff5d-7a30-44cc-97bf-4fb2cb4e0a20 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:10:59.885051 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-09cdff5d-7a30-44cc-97bf-4fb2cb4e0a20 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] [instance: 8e620fdf-cea4-431c-abd4-006a5dd37f88] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:10:59.891372 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-09cdff5d-7a30-44cc-97bf-4fb2cb4e0a20 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:10:59.891816 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-09cdff5d-7a30-44cc-97bf-4fb2cb4e0a20 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:10:59.892648 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-09cdff5d-7a30-44cc-97bf-4fb2cb4e0a20 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:10:59.893101 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-09cdff5d-7a30-44cc-97bf-4fb2cb4e0a20 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:10:59.971990 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-09cdff5d-7a30-44cc-97bf-4fb2cb4e0a20 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] 10.222.0.20 "GET /compute/v2.1/servers/8e620fdf-cea4-431c-abd4-006a5dd37f88/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.090959 Jul 01 04:10:59.972624 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 326/662] 10.222.0.20 () {58 vars in 1274 bytes} [Fri Jul 1 04:10:59 2022] GET /compute/v2.1/servers/8e620fdf-cea4-431c-abd4-006a5dd37f88/os-interface => generated 285 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 01 04:11:00.294524 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-fe175479-559d-40eb-b0f9-473071fd5d98 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] 10.222.0.20 "DELETE /compute/v2.1/servers/5f84252c-dfc7-4c95-a315-5ac40d997d51/os-volume_attachments/6dc25715-337c-433e-8430-fe2e2d29fda3" status: 202 len: 0 microversion: 2.20 time: 0.667133 Jul 01 04:11:00.295139 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 337/663] 10.222.0.20 () {60 vars in 1456 bytes} [Fri Jul 1 04:10:59 2022] DELETE /compute/v2.1/servers/5f84252c-dfc7-4c95-a315-5ac40d997d51/os-volume_attachments/6dc25715-337c-433e-8430-fe2e2d29fda3 => generated 0 bytes in 669 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 01 04:11:00.352791 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-993c1014-ea07-4ae7-b9cb-8c22a55410ec tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 04:11:00.353393 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-993c1014-ea07-4ae7-b9cb-8c22a55410ec tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] [instance: 5f84252c-dfc7-4c95-a315-5ac40d997d51] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:11:00.359830 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-993c1014-ea07-4ae7-b9cb-8c22a55410ec tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:11:00.360284 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-993c1014-ea07-4ae7-b9cb-8c22a55410ec tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:11:00.361059 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-993c1014-ea07-4ae7-b9cb-8c22a55410ec tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:11:00.361843 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-993c1014-ea07-4ae7-b9cb-8c22a55410ec tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:11:00.677195 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-993c1014-ea07-4ae7-b9cb-8c22a55410ec tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] 10.222.0.20 "POST /compute/v2.1/servers/5f84252c-dfc7-4c95-a315-5ac40d997d51/action" status: 202 len: 0 microversion: 2.20 time: 0.328356 Jul 01 04:11:00.683114 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 327/664] 10.222.0.20 () {62 vars in 1318 bytes} [Fri Jul 1 04:11:00 2022] POST /compute/v2.1/servers/5f84252c-dfc7-4c95-a315-5ac40d997d51/action => generated 0 bytes in 333 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 01 04:11:00.690157 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-170d1c74-4ef3-4e8a-85dd-c6822a7d65ea tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:11:00.690690 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-170d1c74-4ef3-4e8a-85dd-c6822a7d65ea tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] [instance: 5f84252c-dfc7-4c95-a315-5ac40d997d51] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:11:00.697795 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-170d1c74-4ef3-4e8a-85dd-c6822a7d65ea tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:11:00.698497 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-170d1c74-4ef3-4e8a-85dd-c6822a7d65ea tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:11:00.699320 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-170d1c74-4ef3-4e8a-85dd-c6822a7d65ea tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:11:00.699800 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-170d1c74-4ef3-4e8a-85dd-c6822a7d65ea tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:11:00.854687 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-170d1c74-4ef3-4e8a-85dd-c6822a7d65ea tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:11:00.866346 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-170d1c74-4ef3-4e8a-85dd-c6822a7d65ea tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:11:00.869607 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-170d1c74-4ef3-4e8a-85dd-c6822a7d65ea tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:11:00.872779 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-170d1c74-4ef3-4e8a-85dd-c6822a7d65ea tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] 10.222.0.20 "GET /compute/v2.1/servers/5f84252c-dfc7-4c95-a315-5ac40d997d51" status: 200 len: 1670 microversion: 2.20 time: 0.186649 Jul 01 04:11:00.873923 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 338/665] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Jul 1 04:11:00 2022] GET /compute/v2.1/servers/5f84252c-dfc7-4c95-a315-5ac40d997d51 => generated 1670 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 04:11:01.062851 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [req-7d7b7c0d-d74f-4bb9-84af-2b2ec935e1f7 req-470e8262-02bb-44c7-8fc3-b2783ffd173e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8e620fdf-cea4-431c-abd4-006a5dd37f88", "tag": "ce5fe4b2-9dff-4c4f-8741-8db0d584da49"}]} {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 04:11:01.072220 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [req-7d7b7c0d-d74f-4bb9-84af-2b2ec935e1f7 req-470e8262-02bb-44c7-8fc3-b2783ffd173e service nova] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:11:01.072751 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [req-7d7b7c0d-d74f-4bb9-84af-2b2ec935e1f7 req-470e8262-02bb-44c7-8fc3-b2783ffd173e service nova] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:11:01.085491 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.compute.server_external_events [req-7d7b7c0d-d74f-4bb9-84af-2b2ec935e1f7 req-470e8262-02bb-44c7-8fc3-b2783ffd173e service nova] Creating event network-changed:ce5fe4b2-9dff-4c4f-8741-8db0d584da49 for instance 8e620fdf-cea4-431c-abd4-006a5dd37f88 on hv-cinder-84684 Jul 01 04:11:01.091389 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [req-7d7b7c0d-d74f-4bb9-84af-2b2ec935e1f7 req-470e8262-02bb-44c7-8fc3-b2783ffd173e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032656 Jul 01 04:11:01.092079 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 328/666] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Jul 1 04:11:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 04:11:01.894909 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-8e9e26c0-1a4b-4d9e-aa8e-8194ad4e0d67 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:11:01.896359 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-8e9e26c0-1a4b-4d9e-aa8e-8194ad4e0d67 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] [instance: 5f84252c-dfc7-4c95-a315-5ac40d997d51] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:11:01.904746 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-8e9e26c0-1a4b-4d9e-aa8e-8194ad4e0d67 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:11:01.908753 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-8e9e26c0-1a4b-4d9e-aa8e-8194ad4e0d67 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:11:01.908753 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-8e9e26c0-1a4b-4d9e-aa8e-8194ad4e0d67 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:11:01.908753 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-8e9e26c0-1a4b-4d9e-aa8e-8194ad4e0d67 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:11:02.072233 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-8e9e26c0-1a4b-4d9e-aa8e-8194ad4e0d67 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:11:02.085872 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-8e9e26c0-1a4b-4d9e-aa8e-8194ad4e0d67 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:11:02.087641 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-8e9e26c0-1a4b-4d9e-aa8e-8194ad4e0d67 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:11:02.101390 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-8e9e26c0-1a4b-4d9e-aa8e-8194ad4e0d67 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] 10.222.0.20 "GET /compute/v2.1/servers/5f84252c-dfc7-4c95-a315-5ac40d997d51" status: 200 len: 1670 microversion: 2.20 time: 0.198840 Jul 01 04:11:02.101390 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 339/667] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Jul 1 04:11:01 2022] GET /compute/v2.1/servers/5f84252c-dfc7-4c95-a315-5ac40d997d51 => generated 1670 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 04:11:03.109071 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-4fc06b61-2978-48de-9d26-b845ed120e67 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:11:03.109764 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-4fc06b61-2978-48de-9d26-b845ed120e67 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] [instance: 5f84252c-dfc7-4c95-a315-5ac40d997d51] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:11:03.115963 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-4fc06b61-2978-48de-9d26-b845ed120e67 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:11:03.116413 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-4fc06b61-2978-48de-9d26-b845ed120e67 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:11:03.117179 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-4fc06b61-2978-48de-9d26-b845ed120e67 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:11:03.117616 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-4fc06b61-2978-48de-9d26-b845ed120e67 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:11:03.333957 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-4fc06b61-2978-48de-9d26-b845ed120e67 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:11:03.342051 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-4fc06b61-2978-48de-9d26-b845ed120e67 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:11:03.343602 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-4fc06b61-2978-48de-9d26-b845ed120e67 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:11:03.344813 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-4fc06b61-2978-48de-9d26-b845ed120e67 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] 10.222.0.20 "GET /compute/v2.1/servers/5f84252c-dfc7-4c95-a315-5ac40d997d51" status: 200 len: 1728 microversion: 2.20 time: 0.240709 Jul 01 04:11:03.345373 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 329/668] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Jul 1 04:11:03 2022] GET /compute/v2.1/servers/5f84252c-dfc7-4c95-a315-5ac40d997d51 => generated 1728 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 04:11:04.363907 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-4eb52ffa-4b34-4a0c-8114-a8bdeca9d209 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:11:04.364562 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-4eb52ffa-4b34-4a0c-8114-a8bdeca9d209 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] [instance: 5f84252c-dfc7-4c95-a315-5ac40d997d51] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:11:04.371710 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-4eb52ffa-4b34-4a0c-8114-a8bdeca9d209 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:11:04.372090 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-4eb52ffa-4b34-4a0c-8114-a8bdeca9d209 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:11:04.372874 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-4eb52ffa-4b34-4a0c-8114-a8bdeca9d209 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:11:04.373362 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-4eb52ffa-4b34-4a0c-8114-a8bdeca9d209 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:11:04.536843 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-4eb52ffa-4b34-4a0c-8114-a8bdeca9d209 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:11:04.552854 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-4eb52ffa-4b34-4a0c-8114-a8bdeca9d209 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:11:04.555849 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-4eb52ffa-4b34-4a0c-8114-a8bdeca9d209 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:11:04.558067 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-4eb52ffa-4b34-4a0c-8114-a8bdeca9d209 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] 10.222.0.20 "GET /compute/v2.1/servers/5f84252c-dfc7-4c95-a315-5ac40d997d51" status: 200 len: 1728 microversion: 2.20 time: 0.197784 Jul 01 04:11:04.559112 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 340/669] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Jul 1 04:11:04 2022] GET /compute/v2.1/servers/5f84252c-dfc7-4c95-a315-5ac40d997d51 => generated 1728 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 04:11:05.577997 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-92444a0c-daa1-4017-ac17-0cf486f92426 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:11:05.578861 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-92444a0c-daa1-4017-ac17-0cf486f92426 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] [instance: 5f84252c-dfc7-4c95-a315-5ac40d997d51] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:11:05.587702 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-92444a0c-daa1-4017-ac17-0cf486f92426 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:11:05.588159 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-92444a0c-daa1-4017-ac17-0cf486f92426 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:11:05.592071 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-92444a0c-daa1-4017-ac17-0cf486f92426 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:11:05.592071 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-92444a0c-daa1-4017-ac17-0cf486f92426 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:11:05.770956 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-92444a0c-daa1-4017-ac17-0cf486f92426 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:11:05.780920 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-92444a0c-daa1-4017-ac17-0cf486f92426 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:11:05.783109 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-92444a0c-daa1-4017-ac17-0cf486f92426 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:11:05.785102 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-92444a0c-daa1-4017-ac17-0cf486f92426 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] 10.222.0.20 "GET /compute/v2.1/servers/5f84252c-dfc7-4c95-a315-5ac40d997d51" status: 200 len: 1728 microversion: 2.20 time: 0.211708 Jul 01 04:11:05.806980 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 330/670] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Jul 1 04:11:05 2022] GET /compute/v2.1/servers/5f84252c-dfc7-4c95-a315-5ac40d997d51 => generated 1728 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 01 04:11:06.818353 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-a89bf77d-e7da-4af3-8bd3-31868e2c2455 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:11:06.819249 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-a89bf77d-e7da-4af3-8bd3-31868e2c2455 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] [instance: 5f84252c-dfc7-4c95-a315-5ac40d997d51] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:11:06.833545 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-a89bf77d-e7da-4af3-8bd3-31868e2c2455 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:11:06.842571 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-a89bf77d-e7da-4af3-8bd3-31868e2c2455 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:11:06.842571 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-a89bf77d-e7da-4af3-8bd3-31868e2c2455 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:11:06.842571 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-a89bf77d-e7da-4af3-8bd3-31868e2c2455 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:11:07.019107 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-a89bf77d-e7da-4af3-8bd3-31868e2c2455 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:11:07.035479 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-a89bf77d-e7da-4af3-8bd3-31868e2c2455 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:11:07.039269 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-a89bf77d-e7da-4af3-8bd3-31868e2c2455 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:11:07.041531 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-a89bf77d-e7da-4af3-8bd3-31868e2c2455 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] 10.222.0.20 "GET /compute/v2.1/servers/5f84252c-dfc7-4c95-a315-5ac40d997d51" status: 200 len: 1728 microversion: 2.20 time: 0.229616 Jul 01 04:11:07.042560 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 341/671] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Jul 1 04:11:06 2022] GET /compute/v2.1/servers/5f84252c-dfc7-4c95-a315-5ac40d997d51 => generated 1728 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 04:11:08.064742 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-7ed9c91e-2b93-4d9e-8b69-cb6e512a6ae3 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:11:08.065431 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-7ed9c91e-2b93-4d9e-8b69-cb6e512a6ae3 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] [instance: 5f84252c-dfc7-4c95-a315-5ac40d997d51] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:11:08.072479 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-7ed9c91e-2b93-4d9e-8b69-cb6e512a6ae3 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:11:08.072960 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-7ed9c91e-2b93-4d9e-8b69-cb6e512a6ae3 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:11:08.073742 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-7ed9c91e-2b93-4d9e-8b69-cb6e512a6ae3 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:11:08.074180 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-7ed9c91e-2b93-4d9e-8b69-cb6e512a6ae3 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:11:08.234497 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-7ed9c91e-2b93-4d9e-8b69-cb6e512a6ae3 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:11:08.243755 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-7ed9c91e-2b93-4d9e-8b69-cb6e512a6ae3 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:11:08.245316 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-7ed9c91e-2b93-4d9e-8b69-cb6e512a6ae3 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:11:08.247297 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-7ed9c91e-2b93-4d9e-8b69-cb6e512a6ae3 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] 10.222.0.20 "GET /compute/v2.1/servers/5f84252c-dfc7-4c95-a315-5ac40d997d51" status: 200 len: 1728 microversion: 2.20 time: 0.185874 Jul 01 04:11:08.247876 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 331/672] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Jul 1 04:11:08 2022] GET /compute/v2.1/servers/5f84252c-dfc7-4c95-a315-5ac40d997d51 => generated 1728 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 04:11:09.267286 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-c6a70c94-7dd8-4a61-8f19-acd1e02a00a5 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:11:09.268250 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-c6a70c94-7dd8-4a61-8f19-acd1e02a00a5 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] [instance: 5f84252c-dfc7-4c95-a315-5ac40d997d51] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:11:09.270538 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG dbcounter [-] [118712] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=3 {{(pid=118712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:11:09.276741 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-c6a70c94-7dd8-4a61-8f19-acd1e02a00a5 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:11:09.277349 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-c6a70c94-7dd8-4a61-8f19-acd1e02a00a5 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:11:09.278302 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-c6a70c94-7dd8-4a61-8f19-acd1e02a00a5 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:11:09.278666 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-c6a70c94-7dd8-4a61-8f19-acd1e02a00a5 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:11:09.426616 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-c6a70c94-7dd8-4a61-8f19-acd1e02a00a5 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:11:09.436166 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-c6a70c94-7dd8-4a61-8f19-acd1e02a00a5 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:11:09.437659 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-c6a70c94-7dd8-4a61-8f19-acd1e02a00a5 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:11:09.438907 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-c6a70c94-7dd8-4a61-8f19-acd1e02a00a5 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] 10.222.0.20 "GET /compute/v2.1/servers/5f84252c-dfc7-4c95-a315-5ac40d997d51" status: 200 len: 1728 microversion: 2.20 time: 0.175687 Jul 01 04:11:09.440065 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 342/673] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Jul 1 04:11:09 2022] GET /compute/v2.1/servers/5f84252c-dfc7-4c95-a315-5ac40d997d51 => generated 1728 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 04:11:10.458955 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-788c4a64-bfad-4282-aebb-3bef6d6f4635 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:11:10.459508 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-788c4a64-bfad-4282-aebb-3bef6d6f4635 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] [instance: 5f84252c-dfc7-4c95-a315-5ac40d997d51] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:11:10.462095 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG dbcounter [-] [118711] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=1 {{(pid=118711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:11:10.467621 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-788c4a64-bfad-4282-aebb-3bef6d6f4635 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:11:10.468130 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-788c4a64-bfad-4282-aebb-3bef6d6f4635 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:11:10.468896 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-788c4a64-bfad-4282-aebb-3bef6d6f4635 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:11:10.469436 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-788c4a64-bfad-4282-aebb-3bef6d6f4635 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:11:10.610411 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-788c4a64-bfad-4282-aebb-3bef6d6f4635 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:11:10.619140 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-788c4a64-bfad-4282-aebb-3bef6d6f4635 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:11:10.620851 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-788c4a64-bfad-4282-aebb-3bef6d6f4635 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:11:10.622285 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-788c4a64-bfad-4282-aebb-3bef6d6f4635 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] 10.222.0.20 "GET /compute/v2.1/servers/5f84252c-dfc7-4c95-a315-5ac40d997d51" status: 200 len: 1728 microversion: 2.20 time: 0.167372 Jul 01 04:11:10.622934 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 332/674] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Jul 1 04:11:10 2022] GET /compute/v2.1/servers/5f84252c-dfc7-4c95-a315-5ac40d997d51 => generated 1728 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 04:11:11.640466 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-0b26a263-f916-4f21-8ad7-5e8bc44c8a87 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:11:11.641273 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-0b26a263-f916-4f21-8ad7-5e8bc44c8a87 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] [instance: 5f84252c-dfc7-4c95-a315-5ac40d997d51] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:11:11.648307 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-0b26a263-f916-4f21-8ad7-5e8bc44c8a87 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:11:11.648767 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-0b26a263-f916-4f21-8ad7-5e8bc44c8a87 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:11:11.649558 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-0b26a263-f916-4f21-8ad7-5e8bc44c8a87 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:11:11.650002 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-0b26a263-f916-4f21-8ad7-5e8bc44c8a87 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:11:11.811984 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-0b26a263-f916-4f21-8ad7-5e8bc44c8a87 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:11:11.821625 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-0b26a263-f916-4f21-8ad7-5e8bc44c8a87 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:11:11.823494 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-0b26a263-f916-4f21-8ad7-5e8bc44c8a87 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:11:11.824924 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-0b26a263-f916-4f21-8ad7-5e8bc44c8a87 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] 10.222.0.20 "GET /compute/v2.1/servers/5f84252c-dfc7-4c95-a315-5ac40d997d51" status: 200 len: 1728 microversion: 2.20 time: 0.188925 Jul 01 04:11:11.825703 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 343/675] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Jul 1 04:11:11 2022] GET /compute/v2.1/servers/5f84252c-dfc7-4c95-a315-5ac40d997d51 => generated 1728 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 01 04:11:12.844604 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-cea3d4d9-55d8-4555-8000-b49c7bc42829 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:11:12.845208 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-cea3d4d9-55d8-4555-8000-b49c7bc42829 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] [instance: 5f84252c-dfc7-4c95-a315-5ac40d997d51] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:11:12.851976 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-cea3d4d9-55d8-4555-8000-b49c7bc42829 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:11:12.852433 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-cea3d4d9-55d8-4555-8000-b49c7bc42829 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:11:12.853280 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-cea3d4d9-55d8-4555-8000-b49c7bc42829 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:11:12.853720 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-cea3d4d9-55d8-4555-8000-b49c7bc42829 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:11:12.992429 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-cea3d4d9-55d8-4555-8000-b49c7bc42829 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:11:13.001330 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-cea3d4d9-55d8-4555-8000-b49c7bc42829 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:11:13.002827 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-cea3d4d9-55d8-4555-8000-b49c7bc42829 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:11:13.004004 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-cea3d4d9-55d8-4555-8000-b49c7bc42829 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] 10.222.0.20 "GET /compute/v2.1/servers/5f84252c-dfc7-4c95-a315-5ac40d997d51" status: 200 len: 1728 microversion: 2.20 time: 0.164031 Jul 01 04:11:13.004560 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 333/676] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Jul 1 04:11:12 2022] GET /compute/v2.1/servers/5f84252c-dfc7-4c95-a315-5ac40d997d51 => generated 1728 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 04:11:14.022647 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-55936f6f-d398-4bc7-95d0-d3456e639522 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:11:14.023280 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-55936f6f-d398-4bc7-95d0-d3456e639522 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] [instance: 5f84252c-dfc7-4c95-a315-5ac40d997d51] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:11:14.030315 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-55936f6f-d398-4bc7-95d0-d3456e639522 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:11:14.030767 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-55936f6f-d398-4bc7-95d0-d3456e639522 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:11:14.031566 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-55936f6f-d398-4bc7-95d0-d3456e639522 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:11:14.032005 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-55936f6f-d398-4bc7-95d0-d3456e639522 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:11:14.165622 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-55936f6f-d398-4bc7-95d0-d3456e639522 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:11:14.173539 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-55936f6f-d398-4bc7-95d0-d3456e639522 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:11:14.175039 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-55936f6f-d398-4bc7-95d0-d3456e639522 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:11:14.176210 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-55936f6f-d398-4bc7-95d0-d3456e639522 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] 10.222.0.20 "GET /compute/v2.1/servers/5f84252c-dfc7-4c95-a315-5ac40d997d51" status: 200 len: 1728 microversion: 2.20 time: 0.157481 Jul 01 04:11:14.176770 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 344/677] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Jul 1 04:11:14 2022] GET /compute/v2.1/servers/5f84252c-dfc7-4c95-a315-5ac40d997d51 => generated 1728 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 04:11:15.196056 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-806c9eb7-68a5-4f41-ad03-5c14e4228deb tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:11:15.196653 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-806c9eb7-68a5-4f41-ad03-5c14e4228deb tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] [instance: 5f84252c-dfc7-4c95-a315-5ac40d997d51] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:11:15.203710 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-806c9eb7-68a5-4f41-ad03-5c14e4228deb tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:11:15.204166 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-806c9eb7-68a5-4f41-ad03-5c14e4228deb tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:11:15.204936 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-806c9eb7-68a5-4f41-ad03-5c14e4228deb tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:11:15.205386 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-806c9eb7-68a5-4f41-ad03-5c14e4228deb tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:11:15.209666 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG dbcounter [-] [118711] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=118711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:11:15.366979 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-806c9eb7-68a5-4f41-ad03-5c14e4228deb tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:11:15.376822 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-806c9eb7-68a5-4f41-ad03-5c14e4228deb tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:11:15.378369 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-806c9eb7-68a5-4f41-ad03-5c14e4228deb tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:11:15.379592 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-806c9eb7-68a5-4f41-ad03-5c14e4228deb tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] 10.222.0.20 "GET /compute/v2.1/servers/5f84252c-dfc7-4c95-a315-5ac40d997d51" status: 200 len: 1728 microversion: 2.20 time: 0.188485 Jul 01 04:11:15.380158 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 334/678] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Jul 1 04:11:15 2022] GET /compute/v2.1/servers/5f84252c-dfc7-4c95-a315-5ac40d997d51 => generated 1728 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 04:11:16.399180 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-e543a44c-f04f-42b8-a17d-9469a1074618 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:11:16.476877 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-e543a44c-f04f-42b8-a17d-9469a1074618 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] [instance: 5f84252c-dfc7-4c95-a315-5ac40d997d51] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:11:16.476877 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-e543a44c-f04f-42b8-a17d-9469a1074618 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:11:16.476877 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-e543a44c-f04f-42b8-a17d-9469a1074618 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:11:16.476877 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-e543a44c-f04f-42b8-a17d-9469a1074618 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:11:16.477389 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-e543a44c-f04f-42b8-a17d-9469a1074618 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:11:16.567781 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-e543a44c-f04f-42b8-a17d-9469a1074618 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:11:16.575706 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-e543a44c-f04f-42b8-a17d-9469a1074618 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:11:16.577728 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-e543a44c-f04f-42b8-a17d-9469a1074618 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:11:16.578882 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-e543a44c-f04f-42b8-a17d-9469a1074618 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] 10.222.0.20 "GET /compute/v2.1/servers/5f84252c-dfc7-4c95-a315-5ac40d997d51" status: 200 len: 1728 microversion: 2.20 time: 0.183681 Jul 01 04:11:16.579550 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 345/679] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Jul 1 04:11:16 2022] GET /compute/v2.1/servers/5f84252c-dfc7-4c95-a315-5ac40d997d51 => generated 1728 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 04:11:17.478079 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [req-81e000f9-f57d-459b-af03-ffb1683fa2e3 req-0186a71b-d4bd-4e96-823e-b94d05612a40 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f84252c-dfc7-4c95-a315-5ac40d997d51", "name": "network-vif-plugged", "status": "completed", "tag": "095204ce-045c-45fd-9ec9-e92cab097c71"}]} {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 04:11:17.487787 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [req-81e000f9-f57d-459b-af03-ffb1683fa2e3 req-0186a71b-d4bd-4e96-823e-b94d05612a40 service nova] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:11:17.488230 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [req-81e000f9-f57d-459b-af03-ffb1683fa2e3 req-0186a71b-d4bd-4e96-823e-b94d05612a40 service nova] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:11:17.499993 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.compute.server_external_events [req-81e000f9-f57d-459b-af03-ffb1683fa2e3 req-0186a71b-d4bd-4e96-823e-b94d05612a40 service nova] Creating event network-vif-plugged:095204ce-045c-45fd-9ec9-e92cab097c71 for instance 5f84252c-dfc7-4c95-a315-5ac40d997d51 on hv-cinder-84684 Jul 01 04:11:17.513395 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [req-81e000f9-f57d-459b-af03-ffb1683fa2e3 req-0186a71b-d4bd-4e96-823e-b94d05612a40 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030702 Jul 01 04:11:17.513395 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 335/680] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Jul 1 04:11:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 04:11:17.599197 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-17fc7fae-159a-429f-b18e-7a4998fe8b17 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:11:17.600096 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-17fc7fae-159a-429f-b18e-7a4998fe8b17 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] [instance: 5f84252c-dfc7-4c95-a315-5ac40d997d51] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:11:17.606850 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-17fc7fae-159a-429f-b18e-7a4998fe8b17 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:11:17.607360 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-17fc7fae-159a-429f-b18e-7a4998fe8b17 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:11:17.608813 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-17fc7fae-159a-429f-b18e-7a4998fe8b17 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:11:17.609257 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-17fc7fae-159a-429f-b18e-7a4998fe8b17 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:11:17.755993 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-17fc7fae-159a-429f-b18e-7a4998fe8b17 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:11:17.764856 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-17fc7fae-159a-429f-b18e-7a4998fe8b17 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:11:17.766414 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-17fc7fae-159a-429f-b18e-7a4998fe8b17 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:11:17.767710 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-17fc7fae-159a-429f-b18e-7a4998fe8b17 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] 10.222.0.20 "GET /compute/v2.1/servers/5f84252c-dfc7-4c95-a315-5ac40d997d51" status: 200 len: 1728 microversion: 2.20 time: 0.172442 Jul 01 04:11:17.776039 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 346/681] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Jul 1 04:11:17 2022] GET /compute/v2.1/servers/5f84252c-dfc7-4c95-a315-5ac40d997d51 => generated 1728 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 04:11:18.787683 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-302e14a2-84bb-4f0a-b451-92b40b93face tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:11:18.788382 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-302e14a2-84bb-4f0a-b451-92b40b93face tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] [instance: 5f84252c-dfc7-4c95-a315-5ac40d997d51] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:11:18.794722 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-302e14a2-84bb-4f0a-b451-92b40b93face tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:11:18.795262 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-302e14a2-84bb-4f0a-b451-92b40b93face tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:11:18.800677 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-302e14a2-84bb-4f0a-b451-92b40b93face tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:11:18.800677 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-302e14a2-84bb-4f0a-b451-92b40b93face tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:11:18.936964 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-302e14a2-84bb-4f0a-b451-92b40b93face tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:11:18.946372 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-302e14a2-84bb-4f0a-b451-92b40b93face tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:11:18.948022 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-302e14a2-84bb-4f0a-b451-92b40b93face tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:11:18.955197 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-302e14a2-84bb-4f0a-b451-92b40b93face tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] 10.222.0.20 "GET /compute/v2.1/servers/5f84252c-dfc7-4c95-a315-5ac40d997d51" status: 200 len: 1728 microversion: 2.20 time: 0.166409 Jul 01 04:11:18.955197 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 336/682] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Jul 1 04:11:18 2022] GET /compute/v2.1/servers/5f84252c-dfc7-4c95-a315-5ac40d997d51 => generated 1728 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 04:11:19.968450 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-7fe7f3ea-12de-42e5-9cd8-d9f115945b9e tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:11:19.969073 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-7fe7f3ea-12de-42e5-9cd8-d9f115945b9e tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] [instance: 5f84252c-dfc7-4c95-a315-5ac40d997d51] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:11:19.976050 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-7fe7f3ea-12de-42e5-9cd8-d9f115945b9e tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:11:19.976512 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-7fe7f3ea-12de-42e5-9cd8-d9f115945b9e tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:11:19.977308 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-7fe7f3ea-12de-42e5-9cd8-d9f115945b9e tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:11:19.977759 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-7fe7f3ea-12de-42e5-9cd8-d9f115945b9e tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:11:20.116050 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-7fe7f3ea-12de-42e5-9cd8-d9f115945b9e tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:11:20.124721 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-7fe7f3ea-12de-42e5-9cd8-d9f115945b9e tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:11:20.126226 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-7fe7f3ea-12de-42e5-9cd8-d9f115945b9e tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:11:20.127410 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-7fe7f3ea-12de-42e5-9cd8-d9f115945b9e tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] 10.222.0.20 "GET /compute/v2.1/servers/5f84252c-dfc7-4c95-a315-5ac40d997d51" status: 200 len: 1728 microversion: 2.20 time: 0.162955 Jul 01 04:11:20.127975 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 347/683] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Jul 1 04:11:19 2022] GET /compute/v2.1/servers/5f84252c-dfc7-4c95-a315-5ac40d997d51 => generated 1728 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 01 04:11:21.146737 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-113f2644-0b26-4d76-9195-aae192ad49fe tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:11:21.147564 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-113f2644-0b26-4d76-9195-aae192ad49fe tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] [instance: 5f84252c-dfc7-4c95-a315-5ac40d997d51] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:11:21.154111 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-113f2644-0b26-4d76-9195-aae192ad49fe tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:11:21.154637 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-113f2644-0b26-4d76-9195-aae192ad49fe tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:11:21.155472 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-113f2644-0b26-4d76-9195-aae192ad49fe tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:11:21.155914 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-113f2644-0b26-4d76-9195-aae192ad49fe tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:11:21.294403 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-113f2644-0b26-4d76-9195-aae192ad49fe tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:11:21.302769 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-113f2644-0b26-4d76-9195-aae192ad49fe tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:11:21.304369 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-113f2644-0b26-4d76-9195-aae192ad49fe tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:11:21.305531 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-113f2644-0b26-4d76-9195-aae192ad49fe tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] 10.222.0.20 "GET /compute/v2.1/servers/5f84252c-dfc7-4c95-a315-5ac40d997d51" status: 200 len: 1715 microversion: 2.20 time: 0.162793 Jul 01 04:11:21.306096 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 337/684] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Jul 1 04:11:21 2022] GET /compute/v2.1/servers/5f84252c-dfc7-4c95-a315-5ac40d997d51 => generated 1715 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 04:11:26.898327 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-0db3e9c7-4634-488c-a558-fe804e63d1ba tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:11:26.899001 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-0db3e9c7-4634-488c-a558-fe804e63d1ba tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] [instance: 246ef166-ec68-4657-b7b2-529c41cb4429] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:11:26.905688 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-0db3e9c7-4634-488c-a558-fe804e63d1ba tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:11:26.911260 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-0db3e9c7-4634-488c-a558-fe804e63d1ba tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:11:26.911260 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-0db3e9c7-4634-488c-a558-fe804e63d1ba tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:11:26.911260 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-0db3e9c7-4634-488c-a558-fe804e63d1ba tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:11:26.933167 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-0db3e9c7-4634-488c-a558-fe804e63d1ba tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] [instance: 246ef166-ec68-4657-b7b2-529c41cb4429] Going to try to terminate instance {{(pid=118712) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 01 04:11:27.054694 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG dbcounter [-] [118712] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=2,nova_cell1:UPDATE=5 {{(pid=118712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:11:27.317525 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-0db3e9c7-4634-488c-a558-fe804e63d1ba tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] 10.222.0.20 "DELETE /compute/v2.1/servers/246ef166-ec68-4657-b7b2-529c41cb4429" status: 204 len: 0 microversion: 2.1 time: 0.422644 Jul 01 04:11:27.318252 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 348/685] 10.222.0.20 () {58 vars in 1238 bytes} [Fri Jul 1 04:11:26 2022] DELETE /compute/v2.1/servers/246ef166-ec68-4657-b7b2-529c41cb4429 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 01 04:11:27.331794 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-eb3cdc85-7bea-4794-b4b4-41eb0b363187 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:11:27.332942 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-eb3cdc85-7bea-4794-b4b4-41eb0b363187 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] [instance: 246ef166-ec68-4657-b7b2-529c41cb4429] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:11:27.343999 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-eb3cdc85-7bea-4794-b4b4-41eb0b363187 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:11:27.344861 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-eb3cdc85-7bea-4794-b4b4-41eb0b363187 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:11:27.346200 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-eb3cdc85-7bea-4794-b4b4-41eb0b363187 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:11:27.346983 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-eb3cdc85-7bea-4794-b4b4-41eb0b363187 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:11:27.495540 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-eb3cdc85-7bea-4794-b4b4-41eb0b363187 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e9707561b4a4811bd7a7d3fed4fcd6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da99a87350634e9ea8a89f314f5e6118', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:11:27.504042 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-eb3cdc85-7bea-4794-b4b4-41eb0b363187 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] 10.222.0.20 "GET /compute/v2.1/servers/246ef166-ec68-4657-b7b2-529c41cb4429" status: 200 len: 1578 microversion: 2.1 time: 0.180631 Jul 01 04:11:27.504642 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 338/686] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:11:27 2022] GET /compute/v2.1/servers/246ef166-ec68-4657-b7b2-529c41cb4429 => generated 1578 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:11:28.522477 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-e935dad0-1faa-407b-81bf-b66f6ee5475f tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:11:28.523176 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-e935dad0-1faa-407b-81bf-b66f6ee5475f tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] [instance: 246ef166-ec68-4657-b7b2-529c41cb4429] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:11:28.530049 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-e935dad0-1faa-407b-81bf-b66f6ee5475f tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:11:28.530500 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-e935dad0-1faa-407b-81bf-b66f6ee5475f tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:11:28.531305 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-e935dad0-1faa-407b-81bf-b66f6ee5475f tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:11:28.531742 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-e935dad0-1faa-407b-81bf-b66f6ee5475f tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:11:28.707480 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-e935dad0-1faa-407b-81bf-b66f6ee5475f tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e9707561b4a4811bd7a7d3fed4fcd6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da99a87350634e9ea8a89f314f5e6118', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:11:28.716052 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-e935dad0-1faa-407b-81bf-b66f6ee5475f tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] 10.222.0.20 "GET /compute/v2.1/servers/246ef166-ec68-4657-b7b2-529c41cb4429" status: 200 len: 1578 microversion: 2.1 time: 0.198102 Jul 01 04:11:28.716648 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 349/687] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:11:28 2022] GET /compute/v2.1/servers/246ef166-ec68-4657-b7b2-529c41cb4429 => generated 1578 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 04:11:29.738059 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-0c1f4754-4911-4eb8-a550-3f47c02a9183 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:11:29.739216 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-0c1f4754-4911-4eb8-a550-3f47c02a9183 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] [instance: 246ef166-ec68-4657-b7b2-529c41cb4429] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:11:29.751394 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-0c1f4754-4911-4eb8-a550-3f47c02a9183 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:11:29.752200 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-0c1f4754-4911-4eb8-a550-3f47c02a9183 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:11:29.753574 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-0c1f4754-4911-4eb8-a550-3f47c02a9183 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:11:29.754409 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-0c1f4754-4911-4eb8-a550-3f47c02a9183 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:11:29.866032 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-0c1f4754-4911-4eb8-a550-3f47c02a9183 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e9707561b4a4811bd7a7d3fed4fcd6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da99a87350634e9ea8a89f314f5e6118', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:11:29.873545 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-0c1f4754-4911-4eb8-a550-3f47c02a9183 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] 10.222.0.20 "GET /compute/v2.1/servers/246ef166-ec68-4657-b7b2-529c41cb4429" status: 200 len: 1511 microversion: 2.1 time: 0.142782 Jul 01 04:11:29.874117 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 339/688] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:11:29 2022] GET /compute/v2.1/servers/246ef166-ec68-4657-b7b2-529c41cb4429 => generated 1511 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:11:29.954553 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [req-a2d7c471-2249-406a-9a53-23d37dd891c7 req-6f0e6d39-6980-43fd-a100-198844cd7aea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "246ef166-ec68-4657-b7b2-529c41cb4429", "name": "network-vif-deleted", "tag": "706047c1-eb46-4189-838b-5b3bd921b5c5"}]} {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 04:11:29.963682 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [req-a2d7c471-2249-406a-9a53-23d37dd891c7 req-6f0e6d39-6980-43fd-a100-198844cd7aea service nova] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:11:29.964138 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [req-a2d7c471-2249-406a-9a53-23d37dd891c7 req-6f0e6d39-6980-43fd-a100-198844cd7aea service nova] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:11:29.978150 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.compute.server_external_events [req-a2d7c471-2249-406a-9a53-23d37dd891c7 req-6f0e6d39-6980-43fd-a100-198844cd7aea service nova] Creating event network-vif-deleted:706047c1-eb46-4189-838b-5b3bd921b5c5 for instance 246ef166-ec68-4657-b7b2-529c41cb4429 on hv-cinder-84684 Jul 01 04:11:29.983901 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [req-a2d7c471-2249-406a-9a53-23d37dd891c7 req-6f0e6d39-6980-43fd-a100-198844cd7aea service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033502 Jul 01 04:11:29.984480 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 350/689] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Jul 1 04:11:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 04:11:30.891320 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-dc199946-a52a-4b3a-bd8a-9a39dfc4a483 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:11:30.892191 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-dc199946-a52a-4b3a-bd8a-9a39dfc4a483 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] [instance: 246ef166-ec68-4657-b7b2-529c41cb4429] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:11:30.899368 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-dc199946-a52a-4b3a-bd8a-9a39dfc4a483 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:11:30.899823 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-dc199946-a52a-4b3a-bd8a-9a39dfc4a483 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:11:30.900625 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-dc199946-a52a-4b3a-bd8a-9a39dfc4a483 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:11:30.901068 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-dc199946-a52a-4b3a-bd8a-9a39dfc4a483 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:11:30.939391 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-dc199946-a52a-4b3a-bd8a-9a39dfc4a483 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:11:30.939840 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-dc199946-a52a-4b3a-bd8a-9a39dfc4a483 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:11:30.940297 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.objects.instance [None req-dc199946-a52a-4b3a-bd8a-9a39dfc4a483 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Lazy-loading 'fault' on Instance uuid 246ef166-ec68-4657-b7b2-529c41cb4429 {{(pid=118711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 04:11:30.985939 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-dc199946-a52a-4b3a-bd8a-9a39dfc4a483 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e9707561b4a4811bd7a7d3fed4fcd6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da99a87350634e9ea8a89f314f5e6118', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:11:30.993843 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-dc199946-a52a-4b3a-bd8a-9a39dfc4a483 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] 10.222.0.20 "GET /compute/v2.1/servers/246ef166-ec68-4657-b7b2-529c41cb4429" status: 200 len: 1231 microversion: 2.1 time: 0.106433 Jul 01 04:11:30.994412 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 340/690] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:11:30 2022] GET /compute/v2.1/servers/246ef166-ec68-4657-b7b2-529c41cb4429 => generated 1231 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:11:32.012819 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-0c65938f-91af-4f73-8e74-f992faae954e tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:11:32.013511 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-0c65938f-91af-4f73-8e74-f992faae954e tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] [instance: 246ef166-ec68-4657-b7b2-529c41cb4429] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:11:32.019999 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-0c65938f-91af-4f73-8e74-f992faae954e tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:11:32.020448 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-0c65938f-91af-4f73-8e74-f992faae954e tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:11:32.021204 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-0c65938f-91af-4f73-8e74-f992faae954e tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:11:32.021638 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-0c65938f-91af-4f73-8e74-f992faae954e tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:11:32.034980 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.wsgi [None req-0c65938f-91af-4f73-8e74-f992faae954e tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] HTTP exception thrown: Instance 246ef166-ec68-4657-b7b2-529c41cb4429 could not be found. Jul 01 04:11:32.036513 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-0c65938f-91af-4f73-8e74-f992faae954e tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Request method failure captured: Jul 01 04:11:32.036513 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: request: GET /compute/v2.1/servers/246ef166-ec68-4657-b7b2-529c41cb4429 HTTP/1.1 Jul 01 04:11:32.036513 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: Accept: application/json Jul 01 04:11:32.036513 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: Accept-Encoding: identity Jul 01 04:11:32.036513 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: Connection: close Jul 01 04:11:32.036513 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: Content-Length: 0 Jul 01 04:11:32.036513 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: Content-Type: application/json Jul 01 04:11:32.036513 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: Host: 10.222.0.20 Jul 01 04:11:32.036513 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: Openstack-System-Scope: None Jul 01 04:11:32.036513 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: User-Agent: python-urllib3/1.26.9 Jul 01 04:11:32.036513 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Auth-Token: gAAAAABivnMVDnkvsZR1pUodfyab59-2FxPgIzqSSqWseKXFyEoXyxlQvSfd9brhIPPd_15UmMlAscx6_Cl9f-36cMkV8_zoTWEyLDWRvuRQ6Z9jOVIM3Ubo43CuoJkis1Gs_uQuS50KPC8FGWybd1JttX4ElDuMRxMmP5z2xlvPCIYdzGMBdpc Jul 01 04:11:32.036513 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Domain-Id: None Jul 01 04:11:32.036513 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Domain-Name: None Jul 01 04:11:32.036513 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Identity-Status: Confirmed Jul 01 04:11:32.036513 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Is-Admin-Project: True Jul 01 04:11:32.036513 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Project-Domain-Id: default Jul 01 04:11:32.036513 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Project-Domain-Name: Default Jul 01 04:11:32.036513 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Project-Id: da99a87350634e9ea8a89f314f5e6118 Jul 01 04:11:32.036513 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Project-Name: tempest-TestVolumeBootPattern-1248148891 Jul 01 04:11:32.036513 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Role: reader,member Jul 01 04:11:32.036513 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Roles: reader,member Jul 01 04:11:32.038267 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/da99a87350634e9ea8a89f314f5e6118"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_da99a87350634e9ea8a89f314f5e6118", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/da99a87350634e9ea8a89f314f5e6118"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/da99a87350634e9ea8a89f314f5e6118"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}] Jul 01 04:11:32.038267 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Tenant: tempest-TestVolumeBootPattern-1248148891 Jul 01 04:11:32.038267 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Tenant-Id: da99a87350634e9ea8a89f314f5e6118 Jul 01 04:11:32.038267 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Tenant-Name: tempest-TestVolumeBootPattern-1248148891 Jul 01 04:11:32.038267 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-User: tempest-TestVolumeBootPattern-1248148891-project Jul 01 04:11:32.038267 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-User-Domain-Id: default Jul 01 04:11:32.038267 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-User-Domain-Name: Default Jul 01 04:11:32.038267 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-User-Id: 2e9707561b4a4811bd7a7d3fed4fcd6b Jul 01 04:11:32.038267 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-User-Name: tempest-TestVolumeBootPattern-1248148891-project Jul 01 04:11:32.038267 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: method: > Jul 01 04:11:32.038267 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: exception: Instance 246ef166-ec68-4657-b7b2-529c41cb4429 could not be found. Jul 01 04:11:32.038267 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: action_args: {'id': '246ef166-ec68-4657-b7b2-529c41cb4429'} Jul 01 04:11:32.039217 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 04:11:32.039217 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 04:11:32.039217 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 04:11:32.039217 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 04:11:32.039217 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 04:11:32.039217 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 04:11:32.039217 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 04:11:32.039217 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 04:11:32.039217 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 04:11:32.039217 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 04:11:32.039217 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 246ef166-ec68-4657-b7b2-529c41cb4429 could not be found. Jul 01 04:11:32.039217 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi Jul 01 04:11:32.039217 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 04:11:32.039217 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi Jul 01 04:11:32.039217 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 04:11:32.039217 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 04:11:32.039217 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 04:11:32.039217 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 04:11:32.039217 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 04:11:32.039217 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 04:11:32.040868 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 04:11:32.040868 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 04:11:32.040868 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 04:11:32.040868 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 04:11:32.040868 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 04:11:32.040868 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 04:11:32.040868 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 04:11:32.040868 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 246ef166-ec68-4657-b7b2-529c41cb4429 could not be found. Jul 01 04:11:32.040868 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi Jul 01 04:11:32.040868 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 04:11:32.040868 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi Jul 01 04:11:32.040868 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 04:11:32.040868 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 04:11:32.040868 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 04:11:32.040868 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 04:11:32.040868 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 04:11:32.040868 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 246ef166-ec68-4657-b7b2-529c41cb4429 could not be found. Jul 01 04:11:32.040868 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi Jul 01 04:11:32.042200 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-0c65938f-91af-4f73-8e74-f992faae954e tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Returning 404 to user: Instance 246ef166-ec68-4657-b7b2-529c41cb4429 could not be found. {{(pid=118712) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 04:11:32.042200 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-0c65938f-91af-4f73-8e74-f992faae954e tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] 10.222.0.20 "GET /compute/v2.1/servers/246ef166-ec68-4657-b7b2-529c41cb4429" status: 404 len: 111 microversion: 2.1 time: 0.029299 Jul 01 04:11:32.042200 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 351/691] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:11:32 2022] GET /compute/v2.1/servers/246ef166-ec68-4657-b7b2-529c41cb4429 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 04:11:32.138854 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-8bed6029-948f-4298-aa53-d12ed223e84b tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-698186512", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1409661036", "security_groups": [{"name": "tempest-secgroup-smoke-708261767"}], "block_device_mapping_v2": [{"uuid": "093185d7-a641-4c7a-88d8-9bd9414b4981", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "cc357e98-d192-47c0-8330-c661a213b80c"}]}} {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 04:11:32.256101 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.network.neutron [None req-8bed6029-948f-4298-aa53-d12ed223e84b tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] validate_networks() for [('cc357e98-d192-47c0-8330-c661a213b80c', None, None, None, None, None)] {{(pid=118711) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 01 04:11:32.650500 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.virt.hardware [None req-8bed6029-948f-4298-aa53-d12ed223e84b tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Flavor limits 0:0:0 {{(pid=118711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 01 04:11:32.650927 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.virt.hardware [None req-8bed6029-948f-4298-aa53-d12ed223e84b tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Image limits 0:0:0 {{(pid=118711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 01 04:11:32.651447 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.virt.hardware [None req-8bed6029-948f-4298-aa53-d12ed223e84b tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Flavor pref 0:0:0 {{(pid=118711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 01 04:11:32.651858 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.virt.hardware [None req-8bed6029-948f-4298-aa53-d12ed223e84b tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Image pref 0:0:0 {{(pid=118711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 01 04:11:32.652364 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.virt.hardware [None req-8bed6029-948f-4298-aa53-d12ed223e84b tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 01 04:11:32.661756 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-8bed6029-948f-4298-aa53-d12ed223e84b tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:11:32.662239 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-8bed6029-948f-4298-aa53-d12ed223e84b tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:11:32.663080 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-8bed6029-948f-4298-aa53-d12ed223e84b tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:11:32.663568 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-8bed6029-948f-4298-aa53-d12ed223e84b tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:11:32.681255 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.quota [None req-8bed6029-948f-4298-aa53-d12ed223e84b tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Getting quotas for project da99a87350634e9ea8a89f314f5e6118. Resources: {'ram', 'cores', 'instances'} {{(pid=118711) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 04:11:32.685483 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.quota [None req-8bed6029-948f-4298-aa53-d12ed223e84b tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Getting quotas for user 2e9707561b4a4811bd7a7d3fed4fcd6b and project da99a87350634e9ea8a89f314f5e6118. Resources: {'ram', 'cores', 'instances'} {{(pid=118711) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 04:11:32.750671 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-8bed6029-948f-4298-aa53-d12ed223e84b tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Going to run 1 instances... {{(pid=118711) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 01 04:11:32.752829 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-8bed6029-948f-4298-aa53-d12ed223e84b tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] [instance: aa92d51d-018c-4829-8e14-4af0f40692f7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='093185d7-a641-4c7a-88d8-9bd9414b4981',volume_size=None,volume_type=None)] {{(pid=118711) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 01 04:11:33.297132 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-8bed6029-948f-4298-aa53-d12ed223e84b tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.162062 Jul 01 04:11:33.298164 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 341/692] 10.222.0.20 () {60 vars in 1146 bytes} [Fri Jul 1 04:11:32 2022] POST /compute/v2.1/servers => generated 405 bytes in 1163 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 01 04:11:33.308235 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-a9daf22b-44c9-4bb9-a3f4-f8c26e5054bb tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:11:33.308860 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-a9daf22b-44c9-4bb9-a3f4-f8c26e5054bb tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] [instance: aa92d51d-018c-4829-8e14-4af0f40692f7] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:11:33.374220 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-a9daf22b-44c9-4bb9-a3f4-f8c26e5054bb tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e9707561b4a4811bd7a7d3fed4fcd6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da99a87350634e9ea8a89f314f5e6118', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:11:33.382154 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-a9daf22b-44c9-4bb9-a3f4-f8c26e5054bb tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] 10.222.0.20 "GET /compute/v2.1/servers/aa92d51d-018c-4829-8e14-4af0f40692f7" status: 200 len: 1094 microversion: 2.1 time: 0.077897 Jul 01 04:11:33.383301 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 352/693] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:11:33 2022] GET /compute/v2.1/servers/aa92d51d-018c-4829-8e14-4af0f40692f7 => generated 1094 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:11:34.405360 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-d1bb0c70-a690-45d0-9dba-afceb0d9cbf7 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:11:34.410329 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-d1bb0c70-a690-45d0-9dba-afceb0d9cbf7 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] [instance: aa92d51d-018c-4829-8e14-4af0f40692f7] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:11:34.416428 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-d1bb0c70-a690-45d0-9dba-afceb0d9cbf7 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:11:34.417672 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-d1bb0c70-a690-45d0-9dba-afceb0d9cbf7 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:11:34.418679 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-d1bb0c70-a690-45d0-9dba-afceb0d9cbf7 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:11:34.419292 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-d1bb0c70-a690-45d0-9dba-afceb0d9cbf7 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:11:34.501850 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-d1bb0c70-a690-45d0-9dba-afceb0d9cbf7 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e9707561b4a4811bd7a7d3fed4fcd6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da99a87350634e9ea8a89f314f5e6118', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:11:34.510133 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-d1bb0c70-a690-45d0-9dba-afceb0d9cbf7 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] 10.222.0.20 "GET /compute/v2.1/servers/aa92d51d-018c-4829-8e14-4af0f40692f7" status: 200 len: 1144 microversion: 2.1 time: 0.112420 Jul 01 04:11:34.510749 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 342/694] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:11:34 2022] GET /compute/v2.1/servers/aa92d51d-018c-4829-8e14-4af0f40692f7 => generated 1144 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:11:35.527837 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-e81696e5-6e17-41d6-b32c-aedf4c694b61 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:11:35.528458 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-e81696e5-6e17-41d6-b32c-aedf4c694b61 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] [instance: aa92d51d-018c-4829-8e14-4af0f40692f7] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:11:35.540628 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-e81696e5-6e17-41d6-b32c-aedf4c694b61 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:11:35.541776 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-e81696e5-6e17-41d6-b32c-aedf4c694b61 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:11:35.543250 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-e81696e5-6e17-41d6-b32c-aedf4c694b61 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:11:35.544002 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-e81696e5-6e17-41d6-b32c-aedf4c694b61 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:11:35.632418 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-e81696e5-6e17-41d6-b32c-aedf4c694b61 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e9707561b4a4811bd7a7d3fed4fcd6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da99a87350634e9ea8a89f314f5e6118', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:11:35.645347 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-e81696e5-6e17-41d6-b32c-aedf4c694b61 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] 10.222.0.20 "GET /compute/v2.1/servers/aa92d51d-018c-4829-8e14-4af0f40692f7" status: 200 len: 1200 microversion: 2.1 time: 0.121046 Jul 01 04:11:35.646359 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 353/695] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:11:35 2022] GET /compute/v2.1/servers/aa92d51d-018c-4829-8e14-4af0f40692f7 => generated 1200 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 04:11:36.673050 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-d972225c-82bc-480d-82cb-c6de3042003b tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:11:36.675726 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-d972225c-82bc-480d-82cb-c6de3042003b tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] [instance: aa92d51d-018c-4829-8e14-4af0f40692f7] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:11:36.686807 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-d972225c-82bc-480d-82cb-c6de3042003b tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:11:36.687816 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-d972225c-82bc-480d-82cb-c6de3042003b tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:11:36.689321 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-d972225c-82bc-480d-82cb-c6de3042003b tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:11:36.689822 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-d972225c-82bc-480d-82cb-c6de3042003b tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:11:36.964025 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-d972225c-82bc-480d-82cb-c6de3042003b tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e9707561b4a4811bd7a7d3fed4fcd6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da99a87350634e9ea8a89f314f5e6118', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:11:36.975624 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-d972225c-82bc-480d-82cb-c6de3042003b tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] 10.222.0.20 "GET /compute/v2.1/servers/aa92d51d-018c-4829-8e14-4af0f40692f7" status: 200 len: 1277 microversion: 2.1 time: 0.307380 Jul 01 04:11:36.976634 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 343/696] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:11:36 2022] GET /compute/v2.1/servers/aa92d51d-018c-4829-8e14-4af0f40692f7 => generated 1277 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:11:37.003305 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-ac48589a-cdbd-4975-9418-3dda79c094d8 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:11:37.005698 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-ac48589a-cdbd-4975-9418-3dda79c094d8 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] [instance: 8e620fdf-cea4-431c-abd4-006a5dd37f88] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:11:37.015520 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-ac48589a-cdbd-4975-9418-3dda79c094d8 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:11:37.017338 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-ac48589a-cdbd-4975-9418-3dda79c094d8 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:11:37.018379 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-ac48589a-cdbd-4975-9418-3dda79c094d8 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:11:37.018912 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-ac48589a-cdbd-4975-9418-3dda79c094d8 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:11:37.057562 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-ac48589a-cdbd-4975-9418-3dda79c094d8 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] 10.222.0.20 "GET /compute/v2.1/servers/8e620fdf-cea4-431c-abd4-006a5dd37f88/ips" status: 200 len: 151 microversion: 2.1 time: 0.059736 Jul 01 04:11:37.058374 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 354/697] 10.222.0.20 () {58 vars in 1247 bytes} [Fri Jul 1 04:11:36 2022] GET /compute/v2.1/servers/8e620fdf-cea4-431c-abd4-006a5dd37f88/ips => generated 151 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 04:11:37.842973 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [req-d974da23-44e4-48a1-b606-1bc400cd16a8 req-350509bb-78c8-42e7-aa53-d423c87e5462 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aa92d51d-018c-4829-8e14-4af0f40692f7", "tag": "5eb0498e-8bd6-446e-a109-b1dadf449fa9"}]} {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 04:11:37.854827 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [req-d974da23-44e4-48a1-b606-1bc400cd16a8 req-350509bb-78c8-42e7-aa53-d423c87e5462 service nova] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:11:37.855314 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [req-d974da23-44e4-48a1-b606-1bc400cd16a8 req-350509bb-78c8-42e7-aa53-d423c87e5462 service nova] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:11:37.867992 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.compute.server_external_events [req-d974da23-44e4-48a1-b606-1bc400cd16a8 req-350509bb-78c8-42e7-aa53-d423c87e5462 service nova] Creating event network-changed:5eb0498e-8bd6-446e-a109-b1dadf449fa9 for instance aa92d51d-018c-4829-8e14-4af0f40692f7 on hv-cinder-84684 Jul 01 04:11:37.878240 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [req-d974da23-44e4-48a1-b606-1bc400cd16a8 req-350509bb-78c8-42e7-aa53-d423c87e5462 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040049 Jul 01 04:11:37.878864 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 344/698] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Jul 1 04:11:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 04:11:37.996136 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-79f0c61f-c89b-4f3a-80e4-dd3b80051872 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:11:37.996764 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-79f0c61f-c89b-4f3a-80e4-dd3b80051872 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] [instance: aa92d51d-018c-4829-8e14-4af0f40692f7] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:11:38.007887 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-79f0c61f-c89b-4f3a-80e4-dd3b80051872 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:11:38.009819 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-79f0c61f-c89b-4f3a-80e4-dd3b80051872 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:11:38.011133 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-79f0c61f-c89b-4f3a-80e4-dd3b80051872 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:11:38.014616 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-79f0c61f-c89b-4f3a-80e4-dd3b80051872 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:11:38.187535 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-79f0c61f-c89b-4f3a-80e4-dd3b80051872 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e9707561b4a4811bd7a7d3fed4fcd6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da99a87350634e9ea8a89f314f5e6118', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:11:38.196064 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-79f0c61f-c89b-4f3a-80e4-dd3b80051872 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] 10.222.0.20 "GET /compute/v2.1/servers/aa92d51d-018c-4829-8e14-4af0f40692f7" status: 200 len: 1265 microversion: 2.1 time: 0.203726 Jul 01 04:11:38.196658 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 355/699] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:11:37 2022] GET /compute/v2.1/servers/aa92d51d-018c-4829-8e14-4af0f40692f7 => generated 1265 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:11:39.085274 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-aad18b72-e53d-4431-91c3-f4815259bbf6 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e7e9b3f8-2c68-4ff0-a1d9-64ba653623e4"}} {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 04:11:39.092062 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-aad18b72-e53d-4431-91c3-f4815259bbf6 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] [instance: 8e620fdf-cea4-431c-abd4-006a5dd37f88] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:11:39.095472 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-aad18b72-e53d-4431-91c3-f4815259bbf6 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:11:39.096097 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-aad18b72-e53d-4431-91c3-f4815259bbf6 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:11:39.097281 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-aad18b72-e53d-4431-91c3-f4815259bbf6 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:11:39.097777 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-aad18b72-e53d-4431-91c3-f4815259bbf6 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:11:39.218584 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-faac452c-b588-4ef0-8690-11b32bf79bc4 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:11:39.219952 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-faac452c-b588-4ef0-8690-11b32bf79bc4 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] [instance: aa92d51d-018c-4829-8e14-4af0f40692f7] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:11:39.228231 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-faac452c-b588-4ef0-8690-11b32bf79bc4 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:11:39.228696 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-faac452c-b588-4ef0-8690-11b32bf79bc4 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:11:39.229480 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-faac452c-b588-4ef0-8690-11b32bf79bc4 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:11:39.229929 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-faac452c-b588-4ef0-8690-11b32bf79bc4 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:11:39.407577 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-faac452c-b588-4ef0-8690-11b32bf79bc4 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e9707561b4a4811bd7a7d3fed4fcd6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da99a87350634e9ea8a89f314f5e6118', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:11:39.421158 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-faac452c-b588-4ef0-8690-11b32bf79bc4 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] 10.222.0.20 "GET /compute/v2.1/servers/aa92d51d-018c-4829-8e14-4af0f40692f7" status: 200 len: 1265 microversion: 2.1 time: 0.209192 Jul 01 04:11:39.428879 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 356/700] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:11:39 2022] GET /compute/v2.1/servers/aa92d51d-018c-4829-8e14-4af0f40692f7 => generated 1265 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:11:40.218871 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-aad18b72-e53d-4431-91c3-f4815259bbf6 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] 10.222.0.20 "POST /compute/v2.1/servers/8e620fdf-cea4-431c-abd4-006a5dd37f88/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.138388 Jul 01 04:11:40.219687 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 345/701] 10.222.0.20 () {60 vars in 1322 bytes} [Fri Jul 1 04:11:39 2022] POST /compute/v2.1/servers/8e620fdf-cea4-431c-abd4-006a5dd37f88/os-volume_attachments => generated 194 bytes in 1140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 01 04:11:40.440575 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-d88bddda-4e26-4440-a360-d346f36157b9 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:11:40.441823 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-d88bddda-4e26-4440-a360-d346f36157b9 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] [instance: aa92d51d-018c-4829-8e14-4af0f40692f7] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:11:40.444456 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG dbcounter [-] [118712] Writing DB stats nova_api:SELECT=37,nova_api:UPDATE=1 {{(pid=118712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:11:40.449720 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-d88bddda-4e26-4440-a360-d346f36157b9 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:11:40.450164 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-d88bddda-4e26-4440-a360-d346f36157b9 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:11:40.450941 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-d88bddda-4e26-4440-a360-d346f36157b9 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:11:40.451503 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-d88bddda-4e26-4440-a360-d346f36157b9 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:11:40.598388 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-d88bddda-4e26-4440-a360-d346f36157b9 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e9707561b4a4811bd7a7d3fed4fcd6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da99a87350634e9ea8a89f314f5e6118', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:11:40.607469 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-d88bddda-4e26-4440-a360-d346f36157b9 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] 10.222.0.20 "GET /compute/v2.1/servers/aa92d51d-018c-4829-8e14-4af0f40692f7" status: 200 len: 1265 microversion: 2.1 time: 0.171220 Jul 01 04:11:40.609055 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 357/702] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:11:40 2022] GET /compute/v2.1/servers/aa92d51d-018c-4829-8e14-4af0f40692f7 => generated 1265 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:11:41.628142 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-572a1758-31d3-41c5-ab5c-f47677f2f369 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:11:41.629049 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-572a1758-31d3-41c5-ab5c-f47677f2f369 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] [instance: aa92d51d-018c-4829-8e14-4af0f40692f7] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:11:41.631120 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG dbcounter [-] [118711] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=3 {{(pid=118711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:11:41.637050 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-572a1758-31d3-41c5-ab5c-f47677f2f369 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:11:41.637512 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-572a1758-31d3-41c5-ab5c-f47677f2f369 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:11:41.638318 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-572a1758-31d3-41c5-ab5c-f47677f2f369 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:11:41.638767 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-572a1758-31d3-41c5-ab5c-f47677f2f369 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:11:41.858321 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-572a1758-31d3-41c5-ab5c-f47677f2f369 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e9707561b4a4811bd7a7d3fed4fcd6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da99a87350634e9ea8a89f314f5e6118', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:11:41.868022 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-572a1758-31d3-41c5-ab5c-f47677f2f369 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] 10.222.0.20 "GET /compute/v2.1/servers/aa92d51d-018c-4829-8e14-4af0f40692f7" status: 200 len: 1265 microversion: 2.1 time: 0.245288 Jul 01 04:11:41.868901 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 346/703] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:11:41 2022] GET /compute/v2.1/servers/aa92d51d-018c-4829-8e14-4af0f40692f7 => generated 1265 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:11:42.885941 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-f68cc858-ec20-401c-bf85-b7f16a65d90b tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:11:42.887069 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-f68cc858-ec20-401c-bf85-b7f16a65d90b tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] [instance: aa92d51d-018c-4829-8e14-4af0f40692f7] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:11:42.894759 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-f68cc858-ec20-401c-bf85-b7f16a65d90b tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:11:42.895214 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-f68cc858-ec20-401c-bf85-b7f16a65d90b tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:11:42.896022 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-f68cc858-ec20-401c-bf85-b7f16a65d90b tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:11:42.896461 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-f68cc858-ec20-401c-bf85-b7f16a65d90b tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:11:43.059124 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-f68cc858-ec20-401c-bf85-b7f16a65d90b tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e9707561b4a4811bd7a7d3fed4fcd6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da99a87350634e9ea8a89f314f5e6118', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:11:43.067991 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-f68cc858-ec20-401c-bf85-b7f16a65d90b tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] 10.222.0.20 "GET /compute/v2.1/servers/aa92d51d-018c-4829-8e14-4af0f40692f7" status: 200 len: 1265 microversion: 2.1 time: 0.186026 Jul 01 04:11:43.071433 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 358/704] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:11:42 2022] GET /compute/v2.1/servers/aa92d51d-018c-4829-8e14-4af0f40692f7 => generated 1265 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:11:44.085454 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-6b8dc187-b7c6-483a-a121-96d730bb3e38 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:11:44.086059 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-6b8dc187-b7c6-483a-a121-96d730bb3e38 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] [instance: aa92d51d-018c-4829-8e14-4af0f40692f7] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:11:44.088421 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG dbcounter [-] [118711] Writing DB stats nova_cell0:SELECT=2 {{(pid=118711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:11:44.089082 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG dbcounter [-] [118711] Writing DB stats nova_cell0:SELECT=6 {{(pid=118711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:11:44.094559 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-6b8dc187-b7c6-483a-a121-96d730bb3e38 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:11:44.095008 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-6b8dc187-b7c6-483a-a121-96d730bb3e38 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:11:44.095793 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-6b8dc187-b7c6-483a-a121-96d730bb3e38 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:11:44.096224 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-6b8dc187-b7c6-483a-a121-96d730bb3e38 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:11:44.236183 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-6b8dc187-b7c6-483a-a121-96d730bb3e38 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e9707561b4a4811bd7a7d3fed4fcd6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da99a87350634e9ea8a89f314f5e6118', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:11:44.245348 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-6b8dc187-b7c6-483a-a121-96d730bb3e38 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] 10.222.0.20 "GET /compute/v2.1/servers/aa92d51d-018c-4829-8e14-4af0f40692f7" status: 200 len: 1265 microversion: 2.1 time: 0.163642 Jul 01 04:11:44.245960 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 347/705] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:11:44 2022] GET /compute/v2.1/servers/aa92d51d-018c-4829-8e14-4af0f40692f7 => generated 1265 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:11:45.262519 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-bb8c3b10-d616-48a7-b47d-6fadf00d290c tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:11:45.263119 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-bb8c3b10-d616-48a7-b47d-6fadf00d290c tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] [instance: aa92d51d-018c-4829-8e14-4af0f40692f7] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:11:45.264990 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG dbcounter [-] [118712] Writing DB stats nova_cell0:SELECT=2 {{(pid=118712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:11:45.270593 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-bb8c3b10-d616-48a7-b47d-6fadf00d290c tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:11:45.271054 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-bb8c3b10-d616-48a7-b47d-6fadf00d290c tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:11:45.271864 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-bb8c3b10-d616-48a7-b47d-6fadf00d290c tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:11:45.272316 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-bb8c3b10-d616-48a7-b47d-6fadf00d290c tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:11:45.419780 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-bb8c3b10-d616-48a7-b47d-6fadf00d290c tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e9707561b4a4811bd7a7d3fed4fcd6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da99a87350634e9ea8a89f314f5e6118', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:11:45.427774 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-bb8c3b10-d616-48a7-b47d-6fadf00d290c tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] 10.222.0.20 "GET /compute/v2.1/servers/aa92d51d-018c-4829-8e14-4af0f40692f7" status: 200 len: 1265 microversion: 2.1 time: 0.169028 Jul 01 04:11:45.428372 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 359/706] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:11:45 2022] GET /compute/v2.1/servers/aa92d51d-018c-4829-8e14-4af0f40692f7 => generated 1265 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 04:11:46.445633 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-8ea290ab-7abb-47ce-82d1-5837b10a8f1f tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:11:46.446247 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-8ea290ab-7abb-47ce-82d1-5837b10a8f1f tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] [instance: aa92d51d-018c-4829-8e14-4af0f40692f7] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:11:46.453709 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-8ea290ab-7abb-47ce-82d1-5837b10a8f1f tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:11:46.454165 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-8ea290ab-7abb-47ce-82d1-5837b10a8f1f tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:11:46.455053 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-8ea290ab-7abb-47ce-82d1-5837b10a8f1f tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:11:46.455420 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-8ea290ab-7abb-47ce-82d1-5837b10a8f1f tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:11:46.458128 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG dbcounter [-] [118711] Writing DB stats nova_cell1:SELECT=78,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:11:46.599421 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-8ea290ab-7abb-47ce-82d1-5837b10a8f1f tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e9707561b4a4811bd7a7d3fed4fcd6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da99a87350634e9ea8a89f314f5e6118', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:11:46.607345 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-8ea290ab-7abb-47ce-82d1-5837b10a8f1f tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] 10.222.0.20 "GET /compute/v2.1/servers/aa92d51d-018c-4829-8e14-4af0f40692f7" status: 200 len: 1265 microversion: 2.1 time: 0.166132 Jul 01 04:11:46.607917 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 348/707] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:11:46 2022] GET /compute/v2.1/servers/aa92d51d-018c-4829-8e14-4af0f40692f7 => generated 1265 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:11:47.626020 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-4e84a304-9440-4ea7-bac3-bdef46743c7f tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:11:47.626827 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-4e84a304-9440-4ea7-bac3-bdef46743c7f tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] [instance: aa92d51d-018c-4829-8e14-4af0f40692f7] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:11:47.633498 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-4e84a304-9440-4ea7-bac3-bdef46743c7f tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:11:47.633960 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-4e84a304-9440-4ea7-bac3-bdef46743c7f tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:11:47.634784 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-4e84a304-9440-4ea7-bac3-bdef46743c7f tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:11:47.635203 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-4e84a304-9440-4ea7-bac3-bdef46743c7f tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:11:47.814134 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-7604db86-ca2d-4bab-917d-5d03ed46b0fa tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Action: 'create', calling method: .version_select at 0x7f99a079cca0>, body: {"keypair": {"name": "tempest-keypair-283043856", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNlMh3dL1VdrcAkJSXDhzbKwxjCa6AqM8cEQlhy5+UJKa3/FxS9wK9vD1AcoGsxRjNXL+iN/spgL/Ap1SPpr47pjNs16WKypNgmWAUV7zVLIGLkTS5yZ2OYlX4jRaYAu6Q=="}} {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 04:11:47.829766 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.quota [None req-7604db86-ca2d-4bab-917d-5d03ed46b0fa tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Getting quotas for project f76a684261dd49f68a42a4e157355f37. Resources: {'key_pairs'} {{(pid=118711) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 04:11:47.834077 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.quota [None req-7604db86-ca2d-4bab-917d-5d03ed46b0fa tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Getting quotas for user 4ac71714265342098d2487a701a6c364 and project f76a684261dd49f68a42a4e157355f37. Resources: {'key_pairs'} {{(pid=118711) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 04:11:47.924912 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-7604db86-ca2d-4bab-917d-5d03ed46b0fa tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.115047 Jul 01 04:11:47.926579 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 349/708] 10.222.0.20 () {60 vars in 1158 bytes} [Fri Jul 1 04:11:47 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 01 04:11:48.041536 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-4e84a304-9440-4ea7-bac3-bdef46743c7f tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e9707561b4a4811bd7a7d3fed4fcd6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da99a87350634e9ea8a89f314f5e6118', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:11:48.052136 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-4e84a304-9440-4ea7-bac3-bdef46743c7f tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] 10.222.0.20 "GET /compute/v2.1/servers/aa92d51d-018c-4829-8e14-4af0f40692f7" status: 200 len: 1265 microversion: 2.1 time: 0.428794 Jul 01 04:11:48.052136 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 360/709] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:11:47 2022] GET /compute/v2.1/servers/aa92d51d-018c-4829-8e14-4af0f40692f7 => generated 1265 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 04:11:49.070863 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-19fc1638-cac6-4582-8fee-26223e61d8e7 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:11:49.071530 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-19fc1638-cac6-4582-8fee-26223e61d8e7 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] [instance: aa92d51d-018c-4829-8e14-4af0f40692f7] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:11:49.079766 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-19fc1638-cac6-4582-8fee-26223e61d8e7 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:11:49.080263 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-19fc1638-cac6-4582-8fee-26223e61d8e7 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:11:49.081040 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-19fc1638-cac6-4582-8fee-26223e61d8e7 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:11:49.081491 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-19fc1638-cac6-4582-8fee-26223e61d8e7 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:11:49.224453 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-19fc1638-cac6-4582-8fee-26223e61d8e7 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e9707561b4a4811bd7a7d3fed4fcd6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da99a87350634e9ea8a89f314f5e6118', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:11:49.232240 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-19fc1638-cac6-4582-8fee-26223e61d8e7 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] 10.222.0.20 "GET /compute/v2.1/servers/aa92d51d-018c-4829-8e14-4af0f40692f7" status: 200 len: 1265 microversion: 2.1 time: 0.165717 Jul 01 04:11:49.232818 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 350/710] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:11:49 2022] GET /compute/v2.1/servers/aa92d51d-018c-4829-8e14-4af0f40692f7 => generated 1265 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:11:49.658457 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [req-d42f89e7-91f6-4149-9969-fc6c42c50eb5 req-59bf1e37-1365-47b1-bc3f-6b6bc61eef20 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa92d51d-018c-4829-8e14-4af0f40692f7", "name": "network-vif-plugged", "status": "completed", "tag": "5eb0498e-8bd6-446e-a109-b1dadf449fa9"}]} {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 04:11:49.667778 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [req-d42f89e7-91f6-4149-9969-fc6c42c50eb5 req-59bf1e37-1365-47b1-bc3f-6b6bc61eef20 service nova] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:11:49.671478 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [req-d42f89e7-91f6-4149-9969-fc6c42c50eb5 req-59bf1e37-1365-47b1-bc3f-6b6bc61eef20 service nova] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:11:49.682212 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.compute.server_external_events [req-d42f89e7-91f6-4149-9969-fc6c42c50eb5 req-59bf1e37-1365-47b1-bc3f-6b6bc61eef20 service nova] Creating event network-vif-plugged:5eb0498e-8bd6-446e-a109-b1dadf449fa9 for instance aa92d51d-018c-4829-8e14-4af0f40692f7 on hv-cinder-84684 Jul 01 04:11:49.686490 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [req-d42f89e7-91f6-4149-9969-fc6c42c50eb5 req-59bf1e37-1365-47b1-bc3f-6b6bc61eef20 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032542 Jul 01 04:11:49.687181 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 361/711] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Jul 1 04:11:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 04:11:50.250001 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-b03ce219-9227-4207-8748-34d62767efaa tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:11:50.250630 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-b03ce219-9227-4207-8748-34d62767efaa tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] [instance: aa92d51d-018c-4829-8e14-4af0f40692f7] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:11:50.257839 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-b03ce219-9227-4207-8748-34d62767efaa tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:11:50.258304 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-b03ce219-9227-4207-8748-34d62767efaa tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:11:50.259087 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-b03ce219-9227-4207-8748-34d62767efaa tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:11:50.259564 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-b03ce219-9227-4207-8748-34d62767efaa tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:11:50.477706 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-b03ce219-9227-4207-8748-34d62767efaa tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e9707561b4a4811bd7a7d3fed4fcd6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da99a87350634e9ea8a89f314f5e6118', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:11:50.486886 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-b03ce219-9227-4207-8748-34d62767efaa tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] 10.222.0.20 "GET /compute/v2.1/servers/aa92d51d-018c-4829-8e14-4af0f40692f7" status: 200 len: 1265 microversion: 2.1 time: 0.240536 Jul 01 04:11:50.487777 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 351/712] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:11:50 2022] GET /compute/v2.1/servers/aa92d51d-018c-4829-8e14-4af0f40692f7 => generated 1265 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:11:50.609049 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-a82581e8-f8b5-4d27-965a-014e1fe35771 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2022370222", "imageRef": "66f9f4ba-339c-4967-8857-d65299a66629", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "72a30e53-10ad-40de-bc68-366d09fc48e5"}], "security_groups": [{"name": "tempest-securitygroup--1466391871"}], "key_name": "tempest-keypair-283043856", "user_data": "}} {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 04:11:50.712387 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.network.neutron [None req-a82581e8-f8b5-4d27-965a-014e1fe35771 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] validate_networks() for [('72a30e53-10ad-40de-bc68-366d09fc48e5', None, None, None, None, None)] {{(pid=118712) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 01 04:11:51.089660 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.virt.hardware [None req-a82581e8-f8b5-4d27-965a-014e1fe35771 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Flavor limits 0:0:0 {{(pid=118712) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 01 04:11:51.090089 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.virt.hardware [None req-a82581e8-f8b5-4d27-965a-014e1fe35771 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Image limits 0:0:0 {{(pid=118712) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 01 04:11:51.090563 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.virt.hardware [None req-a82581e8-f8b5-4d27-965a-014e1fe35771 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Flavor pref 0:0:0 {{(pid=118712) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 01 04:11:51.090969 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.virt.hardware [None req-a82581e8-f8b5-4d27-965a-014e1fe35771 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Image pref 0:0:0 {{(pid=118712) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 01 04:11:51.091430 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.virt.hardware [None req-a82581e8-f8b5-4d27-965a-014e1fe35771 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118712) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 01 04:11:51.100706 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-a82581e8-f8b5-4d27-965a-014e1fe35771 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:11:51.101157 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-a82581e8-f8b5-4d27-965a-014e1fe35771 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:11:51.101951 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-a82581e8-f8b5-4d27-965a-014e1fe35771 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:11:51.102388 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-a82581e8-f8b5-4d27-965a-014e1fe35771 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:11:51.119564 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.quota [None req-a82581e8-f8b5-4d27-965a-014e1fe35771 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Getting quotas for project f76a684261dd49f68a42a4e157355f37. Resources: {'ram', 'cores', 'instances'} {{(pid=118712) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 04:11:51.123544 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.quota [None req-a82581e8-f8b5-4d27-965a-014e1fe35771 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Getting quotas for user 4ac71714265342098d2487a701a6c364 and project f76a684261dd49f68a42a4e157355f37. Resources: {'ram', 'cores', 'instances'} {{(pid=118712) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 04:11:51.134637 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-a82581e8-f8b5-4d27-965a-014e1fe35771 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Going to run 1 instances... {{(pid=118712) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 01 04:11:51.137153 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-a82581e8-f8b5-4d27-965a-014e1fe35771 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] [instance: 81741be3-0961-4d2f-b011-815232b30145] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='66f9f4ba-339c-4967-8857-d65299a66629',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118712) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 01 04:11:51.308837 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-a82581e8-f8b5-4d27-965a-014e1fe35771 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.704305 Jul 01 04:11:51.309686 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 362/713] 10.222.0.20 () {60 vars in 1146 bytes} [Fri Jul 1 04:11:50 2022] POST /compute/v2.1/servers => generated 402 bytes in 706 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 01 04:11:51.319928 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-6310e0ea-cf5e-4749-a1a5-3ab4a1ce368c tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:11:51.320600 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-6310e0ea-cf5e-4749-a1a5-3ab4a1ce368c tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] [instance: 81741be3-0961-4d2f-b011-815232b30145] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:11:51.383311 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-6310e0ea-cf5e-4749-a1a5-3ab4a1ce368c tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac71714265342098d2487a701a6c364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f76a684261dd49f68a42a4e157355f37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:11:51.387493 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-6310e0ea-cf5e-4749-a1a5-3ab4a1ce368c tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] 10.222.0.20 "GET /compute/v2.1/servers/81741be3-0961-4d2f-b011-815232b30145" status: 200 len: 1241 microversion: 2.1 time: 0.071527 Jul 01 04:11:51.388075 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 352/714] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:11:51 2022] GET /compute/v2.1/servers/81741be3-0961-4d2f-b011-815232b30145 => generated 1241 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:11:51.504977 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-01321659-5bc4-42ad-9ca6-90c236f45284 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:11:51.505622 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-01321659-5bc4-42ad-9ca6-90c236f45284 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] [instance: aa92d51d-018c-4829-8e14-4af0f40692f7] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:11:51.512319 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-01321659-5bc4-42ad-9ca6-90c236f45284 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:11:51.512774 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-01321659-5bc4-42ad-9ca6-90c236f45284 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:11:51.513558 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-01321659-5bc4-42ad-9ca6-90c236f45284 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:11:51.514033 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-01321659-5bc4-42ad-9ca6-90c236f45284 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:11:51.661878 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-01321659-5bc4-42ad-9ca6-90c236f45284 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e9707561b4a4811bd7a7d3fed4fcd6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da99a87350634e9ea8a89f314f5e6118', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:11:51.670057 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-01321659-5bc4-42ad-9ca6-90c236f45284 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] 10.222.0.20 "GET /compute/v2.1/servers/aa92d51d-018c-4829-8e14-4af0f40692f7" status: 200 len: 1452 microversion: 2.1 time: 0.169050 Jul 01 04:11:51.671113 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 363/715] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:11:51 2022] GET /compute/v2.1/servers/aa92d51d-018c-4829-8e14-4af0f40692f7 => generated 1452 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:11:51.686086 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-c113cd99-ca74-418e-91a4-823fd6641254 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:11:51.686698 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-c113cd99-ca74-418e-91a4-823fd6641254 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] [instance: aa92d51d-018c-4829-8e14-4af0f40692f7] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:11:51.693508 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-c113cd99-ca74-418e-91a4-823fd6641254 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:11:51.693965 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-c113cd99-ca74-418e-91a4-823fd6641254 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:11:51.694731 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-c113cd99-ca74-418e-91a4-823fd6641254 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:11:51.695170 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-c113cd99-ca74-418e-91a4-823fd6641254 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:11:51.835250 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-c113cd99-ca74-418e-91a4-823fd6641254 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e9707561b4a4811bd7a7d3fed4fcd6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da99a87350634e9ea8a89f314f5e6118', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:11:51.843518 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-c113cd99-ca74-418e-91a4-823fd6641254 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] 10.222.0.20 "GET /compute/v2.1/servers/aa92d51d-018c-4829-8e14-4af0f40692f7" status: 200 len: 1452 microversion: 2.1 time: 0.161171 Jul 01 04:11:51.844111 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 353/716] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:11:51 2022] GET /compute/v2.1/servers/aa92d51d-018c-4829-8e14-4af0f40692f7 => generated 1452 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:11:52.406706 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-496b65a3-b37e-4647-83fd-723681e10b8e tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:11:52.407348 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-496b65a3-b37e-4647-83fd-723681e10b8e tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] [instance: 81741be3-0961-4d2f-b011-815232b30145] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:11:52.413712 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-496b65a3-b37e-4647-83fd-723681e10b8e tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:11:52.414165 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-496b65a3-b37e-4647-83fd-723681e10b8e tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:11:52.414949 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-496b65a3-b37e-4647-83fd-723681e10b8e tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:11:52.415418 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-496b65a3-b37e-4647-83fd-723681e10b8e tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:11:52.503613 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-496b65a3-b37e-4647-83fd-723681e10b8e tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac71714265342098d2487a701a6c364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f76a684261dd49f68a42a4e157355f37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:11:52.515114 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-496b65a3-b37e-4647-83fd-723681e10b8e tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] 10.222.0.20 "GET /compute/v2.1/servers/81741be3-0961-4d2f-b011-815232b30145" status: 200 len: 1245 microversion: 2.1 time: 0.112816 Jul 01 04:11:52.516450 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 364/717] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:11:52 2022] GET /compute/v2.1/servers/81741be3-0961-4d2f-b011-815232b30145 => generated 1245 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:11:53.535130 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-2467af5e-8205-405b-8894-2b468bd5bdfe tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:11:53.536137 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-2467af5e-8205-405b-8894-2b468bd5bdfe tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] [instance: 81741be3-0961-4d2f-b011-815232b30145] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:11:53.543071 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-2467af5e-8205-405b-8894-2b468bd5bdfe tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:11:53.543658 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-2467af5e-8205-405b-8894-2b468bd5bdfe tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:11:53.544643 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-2467af5e-8205-405b-8894-2b468bd5bdfe tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:11:53.545122 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-2467af5e-8205-405b-8894-2b468bd5bdfe tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:11:53.633094 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-2467af5e-8205-405b-8894-2b468bd5bdfe tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac71714265342098d2487a701a6c364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f76a684261dd49f68a42a4e157355f37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:11:53.640944 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-2467af5e-8205-405b-8894-2b468bd5bdfe tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] 10.222.0.20 "GET /compute/v2.1/servers/81741be3-0961-4d2f-b011-815232b30145" status: 200 len: 1301 microversion: 2.1 time: 0.110844 Jul 01 04:11:53.642064 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 354/718] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:11:53 2022] GET /compute/v2.1/servers/81741be3-0961-4d2f-b011-815232b30145 => generated 1301 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:11:54.458571 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-9421224d-52fb-4e5a-b325-7586fe32848a tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:11:54.458571 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-9421224d-52fb-4e5a-b325-7586fe32848a tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] [instance: 5f84252c-dfc7-4c95-a315-5ac40d997d51] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:11:54.462066 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-9421224d-52fb-4e5a-b325-7586fe32848a tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:11:54.462527 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-9421224d-52fb-4e5a-b325-7586fe32848a tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:11:54.463378 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-9421224d-52fb-4e5a-b325-7586fe32848a tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:11:54.463828 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-9421224d-52fb-4e5a-b325-7586fe32848a tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:11:54.496274 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-9421224d-52fb-4e5a-b325-7586fe32848a tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] 10.222.0.20 "GET /compute/v2.1/servers/5f84252c-dfc7-4c95-a315-5ac40d997d51/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.045625 Jul 01 04:11:54.497085 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 365/719] 10.222.0.20 () {60 vars in 1342 bytes} [Fri Jul 1 04:11:54 2022] GET /compute/v2.1/servers/5f84252c-dfc7-4c95-a315-5ac40d997d51/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 04:11:54.516786 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [req-fc900dcc-13d6-4a45-bad5-f37b1e1ea1fc req-73968861-09e4-484a-9f14-80fe773304de service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aa92d51d-018c-4829-8e14-4af0f40692f7", "tag": "5eb0498e-8bd6-446e-a109-b1dadf449fa9"}]} {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 04:11:54.525276 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [req-fc900dcc-13d6-4a45-bad5-f37b1e1ea1fc req-73968861-09e4-484a-9f14-80fe773304de service nova] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:11:54.526079 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [req-fc900dcc-13d6-4a45-bad5-f37b1e1ea1fc req-73968861-09e4-484a-9f14-80fe773304de service nova] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:11:54.538664 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.compute.server_external_events [req-fc900dcc-13d6-4a45-bad5-f37b1e1ea1fc req-73968861-09e4-484a-9f14-80fe773304de service nova] Creating event network-changed:5eb0498e-8bd6-446e-a109-b1dadf449fa9 for instance aa92d51d-018c-4829-8e14-4af0f40692f7 on hv-cinder-84684 Jul 01 04:11:54.545309 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [req-fc900dcc-13d6-4a45-bad5-f37b1e1ea1fc req-73968861-09e4-484a-9f14-80fe773304de service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032105 Jul 01 04:11:54.546629 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 355/720] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Jul 1 04:11:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 04:11:54.570220 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-db4454ee-19d9-497d-9249-f08fc79e53f2 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:11:54.571322 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-db4454ee-19d9-497d-9249-f08fc79e53f2 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] [instance: 5f84252c-dfc7-4c95-a315-5ac40d997d51] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:11:54.578098 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-db4454ee-19d9-497d-9249-f08fc79e53f2 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:11:54.578858 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-db4454ee-19d9-497d-9249-f08fc79e53f2 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:11:54.579912 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-db4454ee-19d9-497d-9249-f08fc79e53f2 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:11:54.580524 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-db4454ee-19d9-497d-9249-f08fc79e53f2 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:11:54.612520 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-db4454ee-19d9-497d-9249-f08fc79e53f2 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] [instance: 5f84252c-dfc7-4c95-a315-5ac40d997d51] Going to try to terminate instance {{(pid=118712) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 01 04:11:54.659614 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-2a67c8b6-97d1-4180-b29f-cdc9239daece tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:11:54.660323 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-2a67c8b6-97d1-4180-b29f-cdc9239daece tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] [instance: 81741be3-0961-4d2f-b011-815232b30145] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:11:54.672085 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-2a67c8b6-97d1-4180-b29f-cdc9239daece tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:11:54.673087 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-2a67c8b6-97d1-4180-b29f-cdc9239daece tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:11:54.674096 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-2a67c8b6-97d1-4180-b29f-cdc9239daece tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:11:54.674699 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-2a67c8b6-97d1-4180-b29f-cdc9239daece tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:11:54.799138 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-2a67c8b6-97d1-4180-b29f-cdc9239daece tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac71714265342098d2487a701a6c364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f76a684261dd49f68a42a4e157355f37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:11:54.813172 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-2a67c8b6-97d1-4180-b29f-cdc9239daece tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] 10.222.0.20 "GET /compute/v2.1/servers/81741be3-0961-4d2f-b011-815232b30145" status: 200 len: 1299 microversion: 2.1 time: 0.157780 Jul 01 04:11:54.813777 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 356/721] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:11:54 2022] GET /compute/v2.1/servers/81741be3-0961-4d2f-b011-815232b30145 => generated 1299 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:11:54.951572 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-db4454ee-19d9-497d-9249-f08fc79e53f2 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] 10.222.0.20 "DELETE /compute/v2.1/servers/5f84252c-dfc7-4c95-a315-5ac40d997d51" status: 204 len: 0 microversion: 2.20 time: 0.385591 Jul 01 04:11:54.952369 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 366/722] 10.222.0.20 () {60 vars in 1279 bytes} [Fri Jul 1 04:11:54 2022] DELETE /compute/v2.1/servers/5f84252c-dfc7-4c95-a315-5ac40d997d51 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 01 04:11:54.964400 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-ffbac1e9-54f7-4d3d-9119-10afb82cc8b6 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:11:54.965663 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-ffbac1e9-54f7-4d3d-9119-10afb82cc8b6 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] [instance: 5f84252c-dfc7-4c95-a315-5ac40d997d51] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:11:54.976509 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-ffbac1e9-54f7-4d3d-9119-10afb82cc8b6 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:11:54.977714 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-ffbac1e9-54f7-4d3d-9119-10afb82cc8b6 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:11:54.978822 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-ffbac1e9-54f7-4d3d-9119-10afb82cc8b6 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:11:54.979498 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-ffbac1e9-54f7-4d3d-9119-10afb82cc8b6 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:11:55.175684 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-ffbac1e9-54f7-4d3d-9119-10afb82cc8b6 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:11:55.184701 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-ffbac1e9-54f7-4d3d-9119-10afb82cc8b6 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:11:55.186581 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-ffbac1e9-54f7-4d3d-9119-10afb82cc8b6 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:11:55.188056 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-ffbac1e9-54f7-4d3d-9119-10afb82cc8b6 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] 10.222.0.20 "GET /compute/v2.1/servers/5f84252c-dfc7-4c95-a315-5ac40d997d51" status: 200 len: 1721 microversion: 2.20 time: 0.231243 Jul 01 04:11:55.188870 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 357/723] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Jul 1 04:11:54 2022] GET /compute/v2.1/servers/5f84252c-dfc7-4c95-a315-5ac40d997d51 => generated 1721 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 04:11:55.834121 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-745a9444-8c99-4fcf-89f6-4e50c3b53fcb tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:11:55.834862 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-745a9444-8c99-4fcf-89f6-4e50c3b53fcb tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] [instance: 81741be3-0961-4d2f-b011-815232b30145] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:11:55.841864 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-745a9444-8c99-4fcf-89f6-4e50c3b53fcb tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:11:55.842358 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-745a9444-8c99-4fcf-89f6-4e50c3b53fcb tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:11:55.843135 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-745a9444-8c99-4fcf-89f6-4e50c3b53fcb tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:11:55.843618 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-745a9444-8c99-4fcf-89f6-4e50c3b53fcb tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:11:55.868012 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG dbcounter [-] [118712] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=118712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:11:56.006620 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-745a9444-8c99-4fcf-89f6-4e50c3b53fcb tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac71714265342098d2487a701a6c364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f76a684261dd49f68a42a4e157355f37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:11:56.015744 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-745a9444-8c99-4fcf-89f6-4e50c3b53fcb tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] 10.222.0.20 "GET /compute/v2.1/servers/81741be3-0961-4d2f-b011-815232b30145" status: 200 len: 1367 microversion: 2.1 time: 0.185710 Jul 01 04:11:56.017770 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 367/724] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:11:55 2022] GET /compute/v2.1/servers/81741be3-0961-4d2f-b011-815232b30145 => generated 1367 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:11:56.207457 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-e6191c93-07c4-491f-b479-24e78c76147d tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:11:56.208194 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-e6191c93-07c4-491f-b479-24e78c76147d tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] [instance: 5f84252c-dfc7-4c95-a315-5ac40d997d51] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:11:56.215326 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-e6191c93-07c4-491f-b479-24e78c76147d tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:11:56.215786 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-e6191c93-07c4-491f-b479-24e78c76147d tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:11:56.225324 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-e6191c93-07c4-491f-b479-24e78c76147d tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:11:56.225324 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-e6191c93-07c4-491f-b479-24e78c76147d tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:11:56.478276 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-e6191c93-07c4-491f-b479-24e78c76147d tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:11:56.492718 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-e6191c93-07c4-491f-b479-24e78c76147d tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:11:56.494359 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-e6191c93-07c4-491f-b479-24e78c76147d tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:11:56.495651 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-e6191c93-07c4-491f-b479-24e78c76147d tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] 10.222.0.20 "GET /compute/v2.1/servers/5f84252c-dfc7-4c95-a315-5ac40d997d51" status: 200 len: 1721 microversion: 2.20 time: 0.292692 Jul 01 04:11:56.496271 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 358/725] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Jul 1 04:11:56 2022] GET /compute/v2.1/servers/5f84252c-dfc7-4c95-a315-5ac40d997d51 => generated 1721 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 01 04:11:56.989639 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [req-ab9da665-f2f2-4679-ac8c-6ec69fa9f3fc req-cf0fa399-69de-435e-805a-41a8f797aba4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "81741be3-0961-4d2f-b011-815232b30145", "tag": "0ab24be8-5070-41c4-80ff-33402e762b2b"}]} {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 04:11:57.001995 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [req-ab9da665-f2f2-4679-ac8c-6ec69fa9f3fc req-cf0fa399-69de-435e-805a-41a8f797aba4 service nova] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:11:57.002457 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [req-ab9da665-f2f2-4679-ac8c-6ec69fa9f3fc req-cf0fa399-69de-435e-805a-41a8f797aba4 service nova] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:11:57.020869 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.compute.server_external_events [req-ab9da665-f2f2-4679-ac8c-6ec69fa9f3fc req-cf0fa399-69de-435e-805a-41a8f797aba4 service nova] Creating event network-changed:0ab24be8-5070-41c4-80ff-33402e762b2b for instance 81741be3-0961-4d2f-b011-815232b30145 on hv-cinder-84684 Jul 01 04:11:57.026050 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [req-ab9da665-f2f2-4679-ac8c-6ec69fa9f3fc req-cf0fa399-69de-435e-805a-41a8f797aba4 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043039 Jul 01 04:11:57.027333 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 368/726] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Jul 1 04:11:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 04:11:57.034030 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-a157d36a-9310-4dbb-bbd0-a8c1b76ab98a tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:11:57.034673 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-a157d36a-9310-4dbb-bbd0-a8c1b76ab98a tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] [instance: 81741be3-0961-4d2f-b011-815232b30145] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:11:57.041649 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-a157d36a-9310-4dbb-bbd0-a8c1b76ab98a tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:11:57.042110 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-a157d36a-9310-4dbb-bbd0-a8c1b76ab98a tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:11:57.043125 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-a157d36a-9310-4dbb-bbd0-a8c1b76ab98a tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:11:57.043789 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-a157d36a-9310-4dbb-bbd0-a8c1b76ab98a tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:11:57.312628 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-a157d36a-9310-4dbb-bbd0-a8c1b76ab98a tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac71714265342098d2487a701a6c364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f76a684261dd49f68a42a4e157355f37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:11:57.334086 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-a157d36a-9310-4dbb-bbd0-a8c1b76ab98a tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] 10.222.0.20 "GET /compute/v2.1/servers/81741be3-0961-4d2f-b011-815232b30145" status: 200 len: 1367 microversion: 2.1 time: 0.304547 Jul 01 04:11:57.340899 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 359/727] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:11:57 2022] GET /compute/v2.1/servers/81741be3-0961-4d2f-b011-815232b30145 => generated 1367 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 04:11:57.443992 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [req-f6b1fd50-180b-460b-bd9a-a59809825577 req-44217447-22a2-4cf2-89c6-8e550d66f9c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f84252c-dfc7-4c95-a315-5ac40d997d51", "name": "network-vif-deleted", "tag": "095204ce-045c-45fd-9ec9-e92cab097c71"}]} {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 04:11:57.464857 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [req-f6b1fd50-180b-460b-bd9a-a59809825577 req-44217447-22a2-4cf2-89c6-8e550d66f9c2 service nova] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:11:57.465679 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [req-f6b1fd50-180b-460b-bd9a-a59809825577 req-44217447-22a2-4cf2-89c6-8e550d66f9c2 service nova] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:11:57.478949 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.compute.server_external_events [req-f6b1fd50-180b-460b-bd9a-a59809825577 req-44217447-22a2-4cf2-89c6-8e550d66f9c2 service nova] Creating event network-vif-deleted:095204ce-045c-45fd-9ec9-e92cab097c71 for instance 5f84252c-dfc7-4c95-a315-5ac40d997d51 on hv-cinder-84684 Jul 01 04:11:57.501346 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [req-f6b1fd50-180b-460b-bd9a-a59809825577 req-44217447-22a2-4cf2-89c6-8e550d66f9c2 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073011 Jul 01 04:11:57.503292 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 369/728] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Jul 1 04:11:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 04:11:57.515190 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-9e29b534-38ed-4a8e-82dc-0f861a2458e9 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:11:57.515872 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-9e29b534-38ed-4a8e-82dc-0f861a2458e9 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] [instance: 5f84252c-dfc7-4c95-a315-5ac40d997d51] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:11:57.527924 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-9e29b534-38ed-4a8e-82dc-0f861a2458e9 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:11:57.529389 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-9e29b534-38ed-4a8e-82dc-0f861a2458e9 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:11:57.531420 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-9e29b534-38ed-4a8e-82dc-0f861a2458e9 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:11:57.532233 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-9e29b534-38ed-4a8e-82dc-0f861a2458e9 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:11:57.648029 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-9e29b534-38ed-4a8e-82dc-0f861a2458e9 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:11:57.673459 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-9e29b534-38ed-4a8e-82dc-0f861a2458e9 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:11:57.677259 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-9e29b534-38ed-4a8e-82dc-0f861a2458e9 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:11:57.680218 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-9e29b534-38ed-4a8e-82dc-0f861a2458e9 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] 10.222.0.20 "GET /compute/v2.1/servers/5f84252c-dfc7-4c95-a315-5ac40d997d51" status: 200 len: 1653 microversion: 2.20 time: 0.169014 Jul 01 04:11:57.681765 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 360/729] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Jul 1 04:11:57 2022] GET /compute/v2.1/servers/5f84252c-dfc7-4c95-a315-5ac40d997d51 => generated 1653 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 04:11:58.356944 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-2e943423-4728-46ba-94e0-1840f71d5410 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:11:58.357884 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-2e943423-4728-46ba-94e0-1840f71d5410 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] [instance: 81741be3-0961-4d2f-b011-815232b30145] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:11:58.365131 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-2e943423-4728-46ba-94e0-1840f71d5410 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:11:58.379205 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-2e943423-4728-46ba-94e0-1840f71d5410 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:11:58.379205 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-2e943423-4728-46ba-94e0-1840f71d5410 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:11:58.379205 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-2e943423-4728-46ba-94e0-1840f71d5410 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:11:58.533078 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-2e943423-4728-46ba-94e0-1840f71d5410 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac71714265342098d2487a701a6c364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f76a684261dd49f68a42a4e157355f37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:11:58.541480 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-2e943423-4728-46ba-94e0-1840f71d5410 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] 10.222.0.20 "GET /compute/v2.1/servers/81741be3-0961-4d2f-b011-815232b30145" status: 200 len: 1367 microversion: 2.1 time: 0.192275 Jul 01 04:11:58.542217 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 370/730] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:11:58 2022] GET /compute/v2.1/servers/81741be3-0961-4d2f-b011-815232b30145 => generated 1367 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:11:58.708859 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-3af25a6e-e7e4-49cc-bf9e-0b7ad8f914ed tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:11:58.709798 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-3af25a6e-e7e4-49cc-bf9e-0b7ad8f914ed tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] [instance: 5f84252c-dfc7-4c95-a315-5ac40d997d51] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:11:58.717283 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-3af25a6e-e7e4-49cc-bf9e-0b7ad8f914ed tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:11:58.717735 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-3af25a6e-e7e4-49cc-bf9e-0b7ad8f914ed tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:11:58.718718 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-3af25a6e-e7e4-49cc-bf9e-0b7ad8f914ed tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:11:58.719191 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-3af25a6e-e7e4-49cc-bf9e-0b7ad8f914ed tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:11:58.754037 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-3af25a6e-e7e4-49cc-bf9e-0b7ad8f914ed tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:11:58.754533 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-3af25a6e-e7e4-49cc-bf9e-0b7ad8f914ed tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:11:58.754991 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.objects.instance [None req-3af25a6e-e7e4-49cc-bf9e-0b7ad8f914ed tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lazy-loading 'fault' on Instance uuid 5f84252c-dfc7-4c95-a315-5ac40d997d51 {{(pid=118711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 04:11:58.800029 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-3af25a6e-e7e4-49cc-bf9e-0b7ad8f914ed tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:11:58.808438 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-3af25a6e-e7e4-49cc-bf9e-0b7ad8f914ed tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:11:58.810002 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-3af25a6e-e7e4-49cc-bf9e-0b7ad8f914ed tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '708734ba3ddc49a3a9dba1d891aeccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dccdb0188264f2686d7275e19f39d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:11:58.811211 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-3af25a6e-e7e4-49cc-bf9e-0b7ad8f914ed tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] 10.222.0.20 "GET /compute/v2.1/servers/5f84252c-dfc7-4c95-a315-5ac40d997d51" status: 200 len: 1370 microversion: 2.20 time: 0.107472 Jul 01 04:11:58.811838 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 361/731] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Jul 1 04:11:58 2022] GET /compute/v2.1/servers/5f84252c-dfc7-4c95-a315-5ac40d997d51 => generated 1370 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 01 04:11:59.558294 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-3a970fc7-19e7-427a-904f-60df13dc0cd5 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:11:59.558947 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-3a970fc7-19e7-427a-904f-60df13dc0cd5 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] [instance: 81741be3-0961-4d2f-b011-815232b30145] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:11:59.566579 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-3a970fc7-19e7-427a-904f-60df13dc0cd5 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:11:59.567055 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-3a970fc7-19e7-427a-904f-60df13dc0cd5 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:11:59.567880 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-3a970fc7-19e7-427a-904f-60df13dc0cd5 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:11:59.568335 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-3a970fc7-19e7-427a-904f-60df13dc0cd5 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:11:59.727614 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-3a970fc7-19e7-427a-904f-60df13dc0cd5 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac71714265342098d2487a701a6c364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f76a684261dd49f68a42a4e157355f37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:11:59.735640 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-3a970fc7-19e7-427a-904f-60df13dc0cd5 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] 10.222.0.20 "GET /compute/v2.1/servers/81741be3-0961-4d2f-b011-815232b30145" status: 200 len: 1367 microversion: 2.1 time: 0.181164 Jul 01 04:11:59.736318 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 371/732] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:11:59 2022] GET /compute/v2.1/servers/81741be3-0961-4d2f-b011-815232b30145 => generated 1367 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:11:59.839862 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-59856ebd-4fe5-4f3b-86aa-326207c5077c tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:11:59.840463 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-59856ebd-4fe5-4f3b-86aa-326207c5077c tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] [instance: 5f84252c-dfc7-4c95-a315-5ac40d997d51] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:11:59.847982 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-59856ebd-4fe5-4f3b-86aa-326207c5077c tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:11:59.848485 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-59856ebd-4fe5-4f3b-86aa-326207c5077c tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:11:59.849260 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-59856ebd-4fe5-4f3b-86aa-326207c5077c tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:11:59.849707 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-59856ebd-4fe5-4f3b-86aa-326207c5077c tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:11:59.864847 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.wsgi [None req-59856ebd-4fe5-4f3b-86aa-326207c5077c tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] HTTP exception thrown: Instance 5f84252c-dfc7-4c95-a315-5ac40d997d51 could not be found. Jul 01 04:11:59.866658 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-59856ebd-4fe5-4f3b-86aa-326207c5077c tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Request method failure captured: Jul 01 04:11:59.866658 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: request: GET /compute/v2.1/servers/5f84252c-dfc7-4c95-a315-5ac40d997d51 HTTP/1.1 Jul 01 04:11:59.866658 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: Accept: application/json Jul 01 04:11:59.866658 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: Accept-Encoding: identity Jul 01 04:11:59.866658 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: Connection: close Jul 01 04:11:59.866658 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: Content-Length: 0 Jul 01 04:11:59.866658 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: Content-Type: application/json Jul 01 04:11:59.866658 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: Host: 10.222.0.20 Jul 01 04:11:59.866658 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: Openstack-System-Scope: None Jul 01 04:11:59.866658 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: User-Agent: python-urllib3/1.26.9 Jul 01 04:11:59.866658 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-Auth-Token: gAAAAABivnJbJtk-Vdr0TH6YVzrkZXSnd-ckPdCFGsFrMW1Xw0J4UduqBITIxqEad-NvPnhYvwjorMjp4X6BuD4OM6xff3u5B2Kkus3vTB-CIXf57EnqC1pcB4n4Ei5LlEl74ZlzNCFsv8iBmA2wlq3q32_Sk0Mmn9JFvndIa4I5_mcJ6fN4ZG8 Jul 01 04:11:59.866658 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-Domain-Id: None Jul 01 04:11:59.866658 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-Domain-Name: None Jul 01 04:11:59.866658 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-Identity-Status: Confirmed Jul 01 04:11:59.866658 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-Is-Admin-Project: True Jul 01 04:11:59.866658 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-Openstack-Nova-Api-Version: 2.20 Jul 01 04:11:59.866658 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-Project-Domain-Id: default Jul 01 04:11:59.866658 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-Project-Domain-Name: Default Jul 01 04:11:59.866658 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-Project-Id: 9dccdb0188264f2686d7275e19f39d05 Jul 01 04:11:59.866658 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1029725038 Jul 01 04:11:59.866658 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-Role: reader,member Jul 01 04:11:59.866658 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-Roles: reader,member Jul 01 04:11:59.869366 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/9dccdb0188264f2686d7275e19f39d05"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_9dccdb0188264f2686d7275e19f39d05", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9dccdb0188264f2686d7275e19f39d05"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9dccdb0188264f2686d7275e19f39d05"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}] Jul 01 04:11:59.869366 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1029725038 Jul 01 04:11:59.869366 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-Tenant-Id: 9dccdb0188264f2686d7275e19f39d05 Jul 01 04:11:59.869366 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1029725038 Jul 01 04:11:59.869366 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-User: tempest-AttachVolumeShelveTestJSON-1029725038-project Jul 01 04:11:59.869366 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-User-Domain-Id: default Jul 01 04:11:59.869366 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-User-Domain-Name: Default Jul 01 04:11:59.869366 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-User-Id: 708734ba3ddc49a3a9dba1d891aeccc7 Jul 01 04:11:59.869366 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1029725038-project Jul 01 04:11:59.869366 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: method: > Jul 01 04:11:59.869366 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: exception: Instance 5f84252c-dfc7-4c95-a315-5ac40d997d51 could not be found. Jul 01 04:11:59.869366 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: action_args: {'id': '5f84252c-dfc7-4c95-a315-5ac40d997d51'} Jul 01 04:11:59.870986 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 04:11:59.870986 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 04:11:59.870986 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 04:11:59.870986 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 04:11:59.870986 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 04:11:59.870986 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 04:11:59.870986 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 04:11:59.870986 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 04:11:59.870986 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 04:11:59.870986 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 04:11:59.870986 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5f84252c-dfc7-4c95-a315-5ac40d997d51 could not be found. Jul 01 04:11:59.870986 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi Jul 01 04:11:59.870986 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 04:11:59.870986 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi Jul 01 04:11:59.870986 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 04:11:59.870986 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 04:11:59.870986 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 04:11:59.870986 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 04:11:59.870986 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 04:11:59.870986 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 04:11:59.873882 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 04:11:59.873882 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 04:11:59.873882 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 04:11:59.873882 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 04:11:59.873882 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 04:11:59.873882 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 04:11:59.873882 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 04:11:59.873882 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5f84252c-dfc7-4c95-a315-5ac40d997d51 could not be found. Jul 01 04:11:59.873882 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi Jul 01 04:11:59.873882 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 04:11:59.873882 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi Jul 01 04:11:59.873882 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 04:11:59.873882 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 04:11:59.873882 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 04:11:59.873882 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 04:11:59.873882 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 04:11:59.873882 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5f84252c-dfc7-4c95-a315-5ac40d997d51 could not be found. Jul 01 04:11:59.873882 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi Jul 01 04:11:59.876214 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-59856ebd-4fe5-4f3b-86aa-326207c5077c tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Returning 404 to user: Instance 5f84252c-dfc7-4c95-a315-5ac40d997d51 could not be found. {{(pid=118711) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 04:11:59.876214 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-59856ebd-4fe5-4f3b-86aa-326207c5077c tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] 10.222.0.20 "GET /compute/v2.1/servers/5f84252c-dfc7-4c95-a315-5ac40d997d51" status: 404 len: 111 microversion: 2.20 time: 0.032330 Jul 01 04:11:59.876214 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 362/733] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Jul 1 04:11:59 2022] GET /compute/v2.1/servers/5f84252c-dfc7-4c95-a315-5ac40d997d51 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 01 04:11:59.879209 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-e96708bb-4d8c-4e1d-a0e1-ee0051304530 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Calling method '.version_select at 0x7f99a06ead30>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:12:00.005298 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-e96708bb-4d8c-4e1d-a0e1-ee0051304530 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-621433929" status: 204 len: 0 microversion: 2.20 time: 0.129701 Jul 01 04:12:00.006071 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 372/734] 10.222.0.20 () {60 vars in 1258 bytes} [Fri Jul 1 04:11:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-621433929 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jul 01 04:12:00.754258 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-5483500f-6fae-47f1-8b78-49e6b20954fb tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:12:00.755126 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-5483500f-6fae-47f1-8b78-49e6b20954fb tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] [instance: 81741be3-0961-4d2f-b011-815232b30145] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:12:00.762131 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-5483500f-6fae-47f1-8b78-49e6b20954fb tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:12:00.762492 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-5483500f-6fae-47f1-8b78-49e6b20954fb tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:12:00.763516 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-5483500f-6fae-47f1-8b78-49e6b20954fb tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:12:00.763952 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-5483500f-6fae-47f1-8b78-49e6b20954fb tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:12:00.933138 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-5483500f-6fae-47f1-8b78-49e6b20954fb tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac71714265342098d2487a701a6c364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f76a684261dd49f68a42a4e157355f37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:12:00.942435 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-5483500f-6fae-47f1-8b78-49e6b20954fb tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] 10.222.0.20 "GET /compute/v2.1/servers/81741be3-0961-4d2f-b011-815232b30145" status: 200 len: 1367 microversion: 2.1 time: 0.192811 Jul 01 04:12:00.943144 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 363/735] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:12:00 2022] GET /compute/v2.1/servers/81741be3-0961-4d2f-b011-815232b30145 => generated 1367 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:12:01.958137 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG dbcounter [-] [118712] Writing DB stats nova_cell0:SELECT=2 {{(pid=118712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:12:01.958890 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG dbcounter [-] [118712] Writing DB stats nova_cell0:SELECT=6 {{(pid=118712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:12:01.968598 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-8d8975e8-2f2e-4aa5-92fa-e6fe483a4d0e tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:12:01.968598 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-8d8975e8-2f2e-4aa5-92fa-e6fe483a4d0e tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] [instance: 81741be3-0961-4d2f-b011-815232b30145] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:12:01.970886 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-8d8975e8-2f2e-4aa5-92fa-e6fe483a4d0e tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:12:01.971405 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-8d8975e8-2f2e-4aa5-92fa-e6fe483a4d0e tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:12:01.972325 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-8d8975e8-2f2e-4aa5-92fa-e6fe483a4d0e tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:12:01.972884 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-8d8975e8-2f2e-4aa5-92fa-e6fe483a4d0e tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:12:02.119833 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-de36f1ea-4737-4d9f-a23f-53a71fdc7610 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:12:02.121009 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-de36f1ea-4737-4d9f-a23f-53a71fdc7610 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] [instance: 5f84252c-dfc7-4c95-a315-5ac40d997d51] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:12:02.123262 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG dbcounter [-] [118711] Writing DB stats nova_cell0:SELECT=6 {{(pid=118711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:12:02.130216 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-de36f1ea-4737-4d9f-a23f-53a71fdc7610 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:12:02.131004 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-de36f1ea-4737-4d9f-a23f-53a71fdc7610 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:12:02.131833 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-de36f1ea-4737-4d9f-a23f-53a71fdc7610 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:12:02.132471 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-de36f1ea-4737-4d9f-a23f-53a71fdc7610 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:12:02.150211 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.wsgi [None req-de36f1ea-4737-4d9f-a23f-53a71fdc7610 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] HTTP exception thrown: Instance 5f84252c-dfc7-4c95-a315-5ac40d997d51 could not be found. Jul 01 04:12:02.151818 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-8d8975e8-2f2e-4aa5-92fa-e6fe483a4d0e tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac71714265342098d2487a701a6c364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f76a684261dd49f68a42a4e157355f37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:12:02.151970 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-de36f1ea-4737-4d9f-a23f-53a71fdc7610 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Request method failure captured: Jul 01 04:12:02.151970 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: request: DELETE /compute/v2.1/servers/5f84252c-dfc7-4c95-a315-5ac40d997d51 HTTP/1.1 Jul 01 04:12:02.151970 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: Accept: application/json Jul 01 04:12:02.151970 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: Accept-Encoding: identity Jul 01 04:12:02.151970 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: Connection: close Jul 01 04:12:02.151970 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: Content-Length: 0 Jul 01 04:12:02.151970 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: Content-Type: application/json Jul 01 04:12:02.151970 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: Host: 10.222.0.20 Jul 01 04:12:02.151970 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: Openstack-System-Scope: None Jul 01 04:12:02.151970 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: User-Agent: python-urllib3/1.26.9 Jul 01 04:12:02.151970 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-Auth-Token: gAAAAABivnJbJtk-Vdr0TH6YVzrkZXSnd-ckPdCFGsFrMW1Xw0J4UduqBITIxqEad-NvPnhYvwjorMjp4X6BuD4OM6xff3u5B2Kkus3vTB-CIXf57EnqC1pcB4n4Ei5LlEl74ZlzNCFsv8iBmA2wlq3q32_Sk0Mmn9JFvndIa4I5_mcJ6fN4ZG8 Jul 01 04:12:02.151970 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-Domain-Id: None Jul 01 04:12:02.151970 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-Domain-Name: None Jul 01 04:12:02.151970 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-Identity-Status: Confirmed Jul 01 04:12:02.151970 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-Is-Admin-Project: True Jul 01 04:12:02.151970 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-Openstack-Nova-Api-Version: 2.20 Jul 01 04:12:02.151970 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-Project-Domain-Id: default Jul 01 04:12:02.151970 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-Project-Domain-Name: Default Jul 01 04:12:02.151970 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-Project-Id: 9dccdb0188264f2686d7275e19f39d05 Jul 01 04:12:02.151970 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1029725038 Jul 01 04:12:02.151970 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-Role: reader,member Jul 01 04:12:02.151970 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-Roles: reader,member Jul 01 04:12:02.153293 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/9dccdb0188264f2686d7275e19f39d05"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_9dccdb0188264f2686d7275e19f39d05", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9dccdb0188264f2686d7275e19f39d05"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9dccdb0188264f2686d7275e19f39d05"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}] Jul 01 04:12:02.153293 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1029725038 Jul 01 04:12:02.153293 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-Tenant-Id: 9dccdb0188264f2686d7275e19f39d05 Jul 01 04:12:02.153293 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1029725038 Jul 01 04:12:02.153293 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-User: tempest-AttachVolumeShelveTestJSON-1029725038-project Jul 01 04:12:02.153293 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-User-Domain-Id: default Jul 01 04:12:02.153293 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-User-Domain-Name: Default Jul 01 04:12:02.153293 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-User-Id: 708734ba3ddc49a3a9dba1d891aeccc7 Jul 01 04:12:02.153293 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1029725038-project Jul 01 04:12:02.153293 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: method: > Jul 01 04:12:02.153293 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: exception: Instance 5f84252c-dfc7-4c95-a315-5ac40d997d51 could not be found. Jul 01 04:12:02.153293 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: action_args: {'id': '5f84252c-dfc7-4c95-a315-5ac40d997d51'} Jul 01 04:12:02.154007 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 04:12:02.154007 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 04:12:02.154007 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 04:12:02.154007 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 04:12:02.154007 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 04:12:02.154007 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 04:12:02.154007 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 04:12:02.154007 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 04:12:02.154007 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 04:12:02.154007 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 04:12:02.154007 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5f84252c-dfc7-4c95-a315-5ac40d997d51 could not be found. Jul 01 04:12:02.154007 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi Jul 01 04:12:02.154007 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 04:12:02.154007 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi Jul 01 04:12:02.154007 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 04:12:02.154007 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 04:12:02.154007 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 04:12:02.154007 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 04:12:02.154007 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 04:12:02.154007 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 04:12:02.155151 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 04:12:02.155151 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 01 04:12:02.155151 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 01 04:12:02.155151 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 01 04:12:02.155151 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 01 04:12:02.155151 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 04:12:02.155151 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 04:12:02.155151 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 04:12:02.155151 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 04:12:02.155151 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5f84252c-dfc7-4c95-a315-5ac40d997d51 could not be found. Jul 01 04:12:02.155151 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi Jul 01 04:12:02.155151 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 04:12:02.155151 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi Jul 01 04:12:02.155151 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 04:12:02.155151 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 04:12:02.155151 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 04:12:02.155151 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 04:12:02.155151 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 04:12:02.155151 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5f84252c-dfc7-4c95-a315-5ac40d997d51 could not be found. Jul 01 04:12:02.155151 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi Jul 01 04:12:02.156450 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-de36f1ea-4737-4d9f-a23f-53a71fdc7610 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Returning 404 to user: Instance 5f84252c-dfc7-4c95-a315-5ac40d997d51 could not be found. {{(pid=118711) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 04:12:02.156450 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-de36f1ea-4737-4d9f-a23f-53a71fdc7610 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] 10.222.0.20 "DELETE /compute/v2.1/servers/5f84252c-dfc7-4c95-a315-5ac40d997d51" status: 404 len: 111 microversion: 2.20 time: 0.038779 Jul 01 04:12:02.157346 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 364/736] 10.222.0.20 () {60 vars in 1279 bytes} [Fri Jul 1 04:12:02 2022] DELETE /compute/v2.1/servers/5f84252c-dfc7-4c95-a315-5ac40d997d51 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jul 01 04:12:02.162267 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-b2c9a695-4d9f-4a7b-ad8e-489e4fedc19e tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:12:02.162504 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-8d8975e8-2f2e-4aa5-92fa-e6fe483a4d0e tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] 10.222.0.20 "GET /compute/v2.1/servers/81741be3-0961-4d2f-b011-815232b30145" status: 200 len: 1367 microversion: 2.1 time: 0.205499 Jul 01 04:12:02.162888 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-b2c9a695-4d9f-4a7b-ad8e-489e4fedc19e tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] [instance: 5f84252c-dfc7-4c95-a315-5ac40d997d51] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:12:02.163307 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 373/737] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:12:01 2022] GET /compute/v2.1/servers/81741be3-0961-4d2f-b011-815232b30145 => generated 1367 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:12:02.169530 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-b2c9a695-4d9f-4a7b-ad8e-489e4fedc19e tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:12:02.176326 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-b2c9a695-4d9f-4a7b-ad8e-489e4fedc19e tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:12:02.176326 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-b2c9a695-4d9f-4a7b-ad8e-489e4fedc19e tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:12:02.176326 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-b2c9a695-4d9f-4a7b-ad8e-489e4fedc19e tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:12:02.186292 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.wsgi [None req-b2c9a695-4d9f-4a7b-ad8e-489e4fedc19e tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] HTTP exception thrown: Instance 5f84252c-dfc7-4c95-a315-5ac40d997d51 could not be found. Jul 01 04:12:02.188658 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-b2c9a695-4d9f-4a7b-ad8e-489e4fedc19e tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Request method failure captured: Jul 01 04:12:02.188658 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: request: GET /compute/v2.1/servers/5f84252c-dfc7-4c95-a315-5ac40d997d51 HTTP/1.1 Jul 01 04:12:02.188658 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: Accept: application/json Jul 01 04:12:02.188658 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: Accept-Encoding: identity Jul 01 04:12:02.188658 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: Connection: close Jul 01 04:12:02.188658 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: Content-Length: 0 Jul 01 04:12:02.188658 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: Content-Type: application/json Jul 01 04:12:02.188658 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: Host: 10.222.0.20 Jul 01 04:12:02.188658 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: Openstack-System-Scope: None Jul 01 04:12:02.188658 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: User-Agent: python-urllib3/1.26.9 Jul 01 04:12:02.188658 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-Auth-Token: gAAAAABivnJbJtk-Vdr0TH6YVzrkZXSnd-ckPdCFGsFrMW1Xw0J4UduqBITIxqEad-NvPnhYvwjorMjp4X6BuD4OM6xff3u5B2Kkus3vTB-CIXf57EnqC1pcB4n4Ei5LlEl74ZlzNCFsv8iBmA2wlq3q32_Sk0Mmn9JFvndIa4I5_mcJ6fN4ZG8 Jul 01 04:12:02.188658 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-Domain-Id: None Jul 01 04:12:02.188658 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-Domain-Name: None Jul 01 04:12:02.188658 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-Identity-Status: Confirmed Jul 01 04:12:02.188658 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-Is-Admin-Project: True Jul 01 04:12:02.188658 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-Openstack-Nova-Api-Version: 2.20 Jul 01 04:12:02.188658 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-Project-Domain-Id: default Jul 01 04:12:02.188658 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-Project-Domain-Name: Default Jul 01 04:12:02.188658 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-Project-Id: 9dccdb0188264f2686d7275e19f39d05 Jul 01 04:12:02.188658 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1029725038 Jul 01 04:12:02.188658 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-Role: reader,member Jul 01 04:12:02.188658 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-Roles: reader,member Jul 01 04:12:02.190245 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/9dccdb0188264f2686d7275e19f39d05"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_9dccdb0188264f2686d7275e19f39d05", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9dccdb0188264f2686d7275e19f39d05"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9dccdb0188264f2686d7275e19f39d05"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}] Jul 01 04:12:02.190245 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1029725038 Jul 01 04:12:02.190245 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-Tenant-Id: 9dccdb0188264f2686d7275e19f39d05 Jul 01 04:12:02.190245 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1029725038 Jul 01 04:12:02.190245 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-User: tempest-AttachVolumeShelveTestJSON-1029725038-project Jul 01 04:12:02.190245 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-User-Domain-Id: default Jul 01 04:12:02.190245 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-User-Domain-Name: Default Jul 01 04:12:02.190245 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-User-Id: 708734ba3ddc49a3a9dba1d891aeccc7 Jul 01 04:12:02.190245 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1029725038-project Jul 01 04:12:02.190245 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: method: > Jul 01 04:12:02.190245 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: exception: Instance 5f84252c-dfc7-4c95-a315-5ac40d997d51 could not be found. Jul 01 04:12:02.190245 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: action_args: {'id': '5f84252c-dfc7-4c95-a315-5ac40d997d51'} Jul 01 04:12:02.191071 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 04:12:02.191071 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 04:12:02.191071 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 04:12:02.191071 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 04:12:02.191071 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 04:12:02.191071 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 04:12:02.191071 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 04:12:02.191071 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 04:12:02.191071 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 04:12:02.191071 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 04:12:02.191071 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5f84252c-dfc7-4c95-a315-5ac40d997d51 could not be found. Jul 01 04:12:02.191071 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi Jul 01 04:12:02.191071 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 04:12:02.191071 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi Jul 01 04:12:02.191071 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 04:12:02.191071 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 04:12:02.191071 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 04:12:02.191071 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 04:12:02.191071 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 04:12:02.191071 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 04:12:02.193678 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 04:12:02.193678 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 04:12:02.193678 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 04:12:02.193678 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 04:12:02.193678 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 04:12:02.193678 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 04:12:02.193678 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 04:12:02.193678 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5f84252c-dfc7-4c95-a315-5ac40d997d51 could not be found. Jul 01 04:12:02.193678 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi Jul 01 04:12:02.193678 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 04:12:02.193678 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi Jul 01 04:12:02.193678 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 04:12:02.193678 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 04:12:02.193678 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 04:12:02.193678 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 04:12:02.193678 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 04:12:02.193678 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5f84252c-dfc7-4c95-a315-5ac40d997d51 could not be found. Jul 01 04:12:02.193678 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi Jul 01 04:12:02.195027 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-b2c9a695-4d9f-4a7b-ad8e-489e4fedc19e tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Returning 404 to user: Instance 5f84252c-dfc7-4c95-a315-5ac40d997d51 could not be found. {{(pid=118711) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 04:12:02.195027 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-b2c9a695-4d9f-4a7b-ad8e-489e4fedc19e tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] 10.222.0.20 "GET /compute/v2.1/servers/5f84252c-dfc7-4c95-a315-5ac40d997d51" status: 404 len: 111 microversion: 2.20 time: 0.031717 Jul 01 04:12:02.195027 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 365/738] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Jul 1 04:12:02 2022] GET /compute/v2.1/servers/5f84252c-dfc7-4c95-a315-5ac40d997d51 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 01 04:12:03.181296 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-5a466c1c-53e8-4b81-b403-d2a4d5cd9a48 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:12:03.181969 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-5a466c1c-53e8-4b81-b403-d2a4d5cd9a48 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] [instance: 81741be3-0961-4d2f-b011-815232b30145] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:12:03.189275 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-5a466c1c-53e8-4b81-b403-d2a4d5cd9a48 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:12:03.189741 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-5a466c1c-53e8-4b81-b403-d2a4d5cd9a48 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:12:03.190536 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-5a466c1c-53e8-4b81-b403-d2a4d5cd9a48 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:12:03.190984 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-5a466c1c-53e8-4b81-b403-d2a4d5cd9a48 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:12:03.338389 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-5a466c1c-53e8-4b81-b403-d2a4d5cd9a48 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac71714265342098d2487a701a6c364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f76a684261dd49f68a42a4e157355f37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:12:03.346397 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-5a466c1c-53e8-4b81-b403-d2a4d5cd9a48 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] 10.222.0.20 "GET /compute/v2.1/servers/81741be3-0961-4d2f-b011-815232b30145" status: 200 len: 1367 microversion: 2.1 time: 0.170277 Jul 01 04:12:03.346983 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 374/739] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:12:03 2022] GET /compute/v2.1/servers/81741be3-0961-4d2f-b011-815232b30145 => generated 1367 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:12:03.523823 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-8a06431d-788f-47eb-91ac-5034c290be2e tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:12:03.524506 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-8a06431d-788f-47eb-91ac-5034c290be2e tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] [instance: b904f233-887c-4c96-a2d2-f7f415ad852f] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:12:03.531958 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-8a06431d-788f-47eb-91ac-5034c290be2e tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:12:03.532338 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-8a06431d-788f-47eb-91ac-5034c290be2e tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:12:03.533122 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-8a06431d-788f-47eb-91ac-5034c290be2e tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:12:03.533565 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-8a06431d-788f-47eb-91ac-5034c290be2e tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:12:03.548511 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.wsgi [None req-8a06431d-788f-47eb-91ac-5034c290be2e tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] HTTP exception thrown: Instance b904f233-887c-4c96-a2d2-f7f415ad852f could not be found. Jul 01 04:12:03.550114 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-8a06431d-788f-47eb-91ac-5034c290be2e tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Request method failure captured: Jul 01 04:12:03.550114 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: request: DELETE /compute/v2.1/servers/b904f233-887c-4c96-a2d2-f7f415ad852f HTTP/1.1 Jul 01 04:12:03.550114 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: Accept: application/json Jul 01 04:12:03.550114 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: Accept-Encoding: identity Jul 01 04:12:03.550114 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: Connection: close Jul 01 04:12:03.550114 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: Content-Length: 0 Jul 01 04:12:03.550114 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: Content-Type: application/json Jul 01 04:12:03.550114 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: Host: 10.222.0.20 Jul 01 04:12:03.550114 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: Openstack-System-Scope: None Jul 01 04:12:03.550114 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: User-Agent: python-urllib3/1.26.9 Jul 01 04:12:03.550114 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-Auth-Token: gAAAAABivnJbJtk-Vdr0TH6YVzrkZXSnd-ckPdCFGsFrMW1Xw0J4UduqBITIxqEad-NvPnhYvwjorMjp4X6BuD4OM6xff3u5B2Kkus3vTB-CIXf57EnqC1pcB4n4Ei5LlEl74ZlzNCFsv8iBmA2wlq3q32_Sk0Mmn9JFvndIa4I5_mcJ6fN4ZG8 Jul 01 04:12:03.550114 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-Domain-Id: None Jul 01 04:12:03.550114 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-Domain-Name: None Jul 01 04:12:03.550114 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-Identity-Status: Confirmed Jul 01 04:12:03.550114 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-Is-Admin-Project: True Jul 01 04:12:03.550114 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-Openstack-Nova-Api-Version: 2.20 Jul 01 04:12:03.550114 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-Project-Domain-Id: default Jul 01 04:12:03.550114 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-Project-Domain-Name: Default Jul 01 04:12:03.550114 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-Project-Id: 9dccdb0188264f2686d7275e19f39d05 Jul 01 04:12:03.550114 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1029725038 Jul 01 04:12:03.550114 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-Role: reader,member Jul 01 04:12:03.550114 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-Roles: reader,member Jul 01 04:12:03.552623 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/9dccdb0188264f2686d7275e19f39d05"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_9dccdb0188264f2686d7275e19f39d05", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9dccdb0188264f2686d7275e19f39d05"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9dccdb0188264f2686d7275e19f39d05"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}] Jul 01 04:12:03.552623 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1029725038 Jul 01 04:12:03.552623 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-Tenant-Id: 9dccdb0188264f2686d7275e19f39d05 Jul 01 04:12:03.552623 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1029725038 Jul 01 04:12:03.552623 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-User: tempest-AttachVolumeShelveTestJSON-1029725038-project Jul 01 04:12:03.552623 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-User-Domain-Id: default Jul 01 04:12:03.552623 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-User-Domain-Name: Default Jul 01 04:12:03.552623 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-User-Id: 708734ba3ddc49a3a9dba1d891aeccc7 Jul 01 04:12:03.552623 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1029725038-project Jul 01 04:12:03.552623 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: method: > Jul 01 04:12:03.552623 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: exception: Instance b904f233-887c-4c96-a2d2-f7f415ad852f could not be found. Jul 01 04:12:03.552623 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: action_args: {'id': 'b904f233-887c-4c96-a2d2-f7f415ad852f'} Jul 01 04:12:03.553998 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 04:12:03.553998 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 04:12:03.553998 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 04:12:03.553998 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 04:12:03.553998 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 04:12:03.553998 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 04:12:03.553998 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 04:12:03.553998 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 04:12:03.553998 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 04:12:03.553998 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 04:12:03.553998 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b904f233-887c-4c96-a2d2-f7f415ad852f could not be found. Jul 01 04:12:03.553998 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi Jul 01 04:12:03.553998 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 04:12:03.553998 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi Jul 01 04:12:03.553998 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 04:12:03.553998 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 04:12:03.553998 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 04:12:03.553998 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 04:12:03.553998 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 04:12:03.553998 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 04:12:03.555483 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 04:12:03.555483 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 01 04:12:03.555483 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 01 04:12:03.555483 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 01 04:12:03.555483 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 01 04:12:03.555483 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 04:12:03.555483 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 04:12:03.555483 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 04:12:03.555483 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 04:12:03.555483 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b904f233-887c-4c96-a2d2-f7f415ad852f could not be found. Jul 01 04:12:03.555483 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi Jul 01 04:12:03.555483 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 04:12:03.555483 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi Jul 01 04:12:03.555483 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 04:12:03.555483 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 04:12:03.555483 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 04:12:03.555483 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 04:12:03.555483 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 04:12:03.555483 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b904f233-887c-4c96-a2d2-f7f415ad852f could not be found. Jul 01 04:12:03.555483 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi Jul 01 04:12:03.556925 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-8a06431d-788f-47eb-91ac-5034c290be2e tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Returning 404 to user: Instance b904f233-887c-4c96-a2d2-f7f415ad852f could not be found. {{(pid=118711) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 04:12:03.556925 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-8a06431d-788f-47eb-91ac-5034c290be2e tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] 10.222.0.20 "DELETE /compute/v2.1/servers/b904f233-887c-4c96-a2d2-f7f415ad852f" status: 404 len: 111 microversion: 2.20 time: 0.032864 Jul 01 04:12:03.556925 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 366/740] 10.222.0.20 () {60 vars in 1279 bytes} [Fri Jul 1 04:12:03 2022] DELETE /compute/v2.1/servers/b904f233-887c-4c96-a2d2-f7f415ad852f => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 01 04:12:03.566882 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-8e0cf3a3-7810-4377-bd21-13fb06ffe516 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:12:03.567532 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-8e0cf3a3-7810-4377-bd21-13fb06ffe516 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] [instance: b904f233-887c-4c96-a2d2-f7f415ad852f] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:12:03.573937 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-8e0cf3a3-7810-4377-bd21-13fb06ffe516 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:12:03.574394 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-8e0cf3a3-7810-4377-bd21-13fb06ffe516 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:12:03.575206 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-8e0cf3a3-7810-4377-bd21-13fb06ffe516 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:12:03.575738 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-8e0cf3a3-7810-4377-bd21-13fb06ffe516 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:12:03.590376 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.wsgi [None req-8e0cf3a3-7810-4377-bd21-13fb06ffe516 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] HTTP exception thrown: Instance b904f233-887c-4c96-a2d2-f7f415ad852f could not be found. Jul 01 04:12:03.592088 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-8e0cf3a3-7810-4377-bd21-13fb06ffe516 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Request method failure captured: Jul 01 04:12:03.592088 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: request: GET /compute/v2.1/servers/b904f233-887c-4c96-a2d2-f7f415ad852f HTTP/1.1 Jul 01 04:12:03.592088 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: Accept: application/json Jul 01 04:12:03.592088 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: Accept-Encoding: identity Jul 01 04:12:03.592088 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: Connection: close Jul 01 04:12:03.592088 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: Content-Length: 0 Jul 01 04:12:03.592088 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: Content-Type: application/json Jul 01 04:12:03.592088 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: Host: 10.222.0.20 Jul 01 04:12:03.592088 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: Openstack-System-Scope: None Jul 01 04:12:03.592088 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: User-Agent: python-urllib3/1.26.9 Jul 01 04:12:03.592088 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Auth-Token: gAAAAABivnJbJtk-Vdr0TH6YVzrkZXSnd-ckPdCFGsFrMW1Xw0J4UduqBITIxqEad-NvPnhYvwjorMjp4X6BuD4OM6xff3u5B2Kkus3vTB-CIXf57EnqC1pcB4n4Ei5LlEl74ZlzNCFsv8iBmA2wlq3q32_Sk0Mmn9JFvndIa4I5_mcJ6fN4ZG8 Jul 01 04:12:03.592088 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Domain-Id: None Jul 01 04:12:03.592088 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Domain-Name: None Jul 01 04:12:03.592088 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Identity-Status: Confirmed Jul 01 04:12:03.592088 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Is-Admin-Project: True Jul 01 04:12:03.592088 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Openstack-Nova-Api-Version: 2.20 Jul 01 04:12:03.592088 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Project-Domain-Id: default Jul 01 04:12:03.592088 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Project-Domain-Name: Default Jul 01 04:12:03.592088 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Project-Id: 9dccdb0188264f2686d7275e19f39d05 Jul 01 04:12:03.592088 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1029725038 Jul 01 04:12:03.592088 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Role: reader,member Jul 01 04:12:03.592088 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Roles: reader,member Jul 01 04:12:03.593682 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/9dccdb0188264f2686d7275e19f39d05"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_9dccdb0188264f2686d7275e19f39d05", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9dccdb0188264f2686d7275e19f39d05"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9dccdb0188264f2686d7275e19f39d05"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}] Jul 01 04:12:03.593682 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1029725038 Jul 01 04:12:03.593682 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Tenant-Id: 9dccdb0188264f2686d7275e19f39d05 Jul 01 04:12:03.593682 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1029725038 Jul 01 04:12:03.593682 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-User: tempest-AttachVolumeShelveTestJSON-1029725038-project Jul 01 04:12:03.593682 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-User-Domain-Id: default Jul 01 04:12:03.593682 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-User-Domain-Name: Default Jul 01 04:12:03.593682 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-User-Id: 708734ba3ddc49a3a9dba1d891aeccc7 Jul 01 04:12:03.593682 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1029725038-project Jul 01 04:12:03.593682 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: method: > Jul 01 04:12:03.593682 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: exception: Instance b904f233-887c-4c96-a2d2-f7f415ad852f could not be found. Jul 01 04:12:03.593682 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: action_args: {'id': 'b904f233-887c-4c96-a2d2-f7f415ad852f'} Jul 01 04:12:03.594669 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 04:12:03.594669 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 04:12:03.594669 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 04:12:03.594669 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 04:12:03.594669 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 04:12:03.594669 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 04:12:03.594669 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 04:12:03.594669 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 04:12:03.594669 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 04:12:03.594669 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 04:12:03.594669 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b904f233-887c-4c96-a2d2-f7f415ad852f could not be found. Jul 01 04:12:03.594669 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi Jul 01 04:12:03.594669 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 04:12:03.594669 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi Jul 01 04:12:03.594669 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 04:12:03.594669 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 04:12:03.594669 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 04:12:03.594669 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 04:12:03.594669 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 04:12:03.594669 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 04:12:03.596472 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 04:12:03.596472 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 04:12:03.596472 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 04:12:03.596472 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 04:12:03.596472 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 04:12:03.596472 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 04:12:03.596472 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 04:12:03.596472 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b904f233-887c-4c96-a2d2-f7f415ad852f could not be found. Jul 01 04:12:03.596472 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi Jul 01 04:12:03.596472 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 04:12:03.596472 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi Jul 01 04:12:03.596472 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 04:12:03.596472 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 04:12:03.596472 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 04:12:03.596472 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 04:12:03.596472 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 04:12:03.596472 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b904f233-887c-4c96-a2d2-f7f415ad852f could not be found. Jul 01 04:12:03.596472 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi Jul 01 04:12:03.597957 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-8e0cf3a3-7810-4377-bd21-13fb06ffe516 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] Returning 404 to user: Instance b904f233-887c-4c96-a2d2-f7f415ad852f could not be found. {{(pid=118712) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 04:12:03.597957 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-8e0cf3a3-7810-4377-bd21-13fb06ffe516 tempest-AttachVolumeShelveTestJSON-1029725038 tempest-AttachVolumeShelveTestJSON-1029725038-project] 10.222.0.20 "GET /compute/v2.1/servers/b904f233-887c-4c96-a2d2-f7f415ad852f" status: 404 len: 111 microversion: 2.20 time: 0.031521 Jul 01 04:12:03.597957 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 375/741] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Jul 1 04:12:03 2022] GET /compute/v2.1/servers/b904f233-887c-4c96-a2d2-f7f415ad852f => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 01 04:12:03.818991 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [req-5cea9fae-5829-4dd6-85a5-67edddf50e2c req-14521b60-92c5-4e6b-beec-39c4aa340fb9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "81741be3-0961-4d2f-b011-815232b30145", "name": "network-vif-plugged", "status": "completed", "tag": "0ab24be8-5070-41c4-80ff-33402e762b2b"}]} {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 04:12:03.833108 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [req-5cea9fae-5829-4dd6-85a5-67edddf50e2c req-14521b60-92c5-4e6b-beec-39c4aa340fb9 service nova] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:12:03.833560 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [req-5cea9fae-5829-4dd6-85a5-67edddf50e2c req-14521b60-92c5-4e6b-beec-39c4aa340fb9 service nova] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:12:03.847806 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.compute.server_external_events [req-5cea9fae-5829-4dd6-85a5-67edddf50e2c req-14521b60-92c5-4e6b-beec-39c4aa340fb9 service nova] Creating event network-vif-plugged:0ab24be8-5070-41c4-80ff-33402e762b2b for instance 81741be3-0961-4d2f-b011-815232b30145 on hv-cinder-84684 Jul 01 04:12:03.853262 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [req-5cea9fae-5829-4dd6-85a5-67edddf50e2c req-14521b60-92c5-4e6b-beec-39c4aa340fb9 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042059 Jul 01 04:12:03.854054 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 367/742] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Jul 1 04:12:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 04:12:04.365128 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-2bdae8cb-4768-4782-990f-57571bde71cf tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:12:04.366179 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-2bdae8cb-4768-4782-990f-57571bde71cf tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] [instance: 81741be3-0961-4d2f-b011-815232b30145] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:12:04.374836 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-2bdae8cb-4768-4782-990f-57571bde71cf tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:12:04.375972 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-2bdae8cb-4768-4782-990f-57571bde71cf tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:12:04.376798 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-2bdae8cb-4768-4782-990f-57571bde71cf tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:12:04.377245 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-2bdae8cb-4768-4782-990f-57571bde71cf tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:12:04.864179 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-2bdae8cb-4768-4782-990f-57571bde71cf tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac71714265342098d2487a701a6c364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f76a684261dd49f68a42a4e157355f37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:12:04.872421 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-2bdae8cb-4768-4782-990f-57571bde71cf tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] 10.222.0.20 "GET /compute/v2.1/servers/81741be3-0961-4d2f-b011-815232b30145" status: 200 len: 1367 microversion: 2.1 time: 0.512408 Jul 01 04:12:04.873014 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 376/743] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:12:04 2022] GET /compute/v2.1/servers/81741be3-0961-4d2f-b011-815232b30145 => generated 1367 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:12:05.891278 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-16a22359-bc10-4eca-b75e-932f8d403c57 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:12:05.892780 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-16a22359-bc10-4eca-b75e-932f8d403c57 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] [instance: 81741be3-0961-4d2f-b011-815232b30145] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:12:05.901255 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-16a22359-bc10-4eca-b75e-932f8d403c57 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:12:05.901705 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-16a22359-bc10-4eca-b75e-932f8d403c57 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:12:05.902507 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-16a22359-bc10-4eca-b75e-932f8d403c57 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:12:05.903282 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-16a22359-bc10-4eca-b75e-932f8d403c57 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:12:06.120834 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-16a22359-bc10-4eca-b75e-932f8d403c57 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac71714265342098d2487a701a6c364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f76a684261dd49f68a42a4e157355f37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:12:06.129914 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-16a22359-bc10-4eca-b75e-932f8d403c57 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] 10.222.0.20 "GET /compute/v2.1/servers/81741be3-0961-4d2f-b011-815232b30145" status: 200 len: 1367 microversion: 2.1 time: 0.244042 Jul 01 04:12:06.130514 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 368/744] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:12:05 2022] GET /compute/v2.1/servers/81741be3-0961-4d2f-b011-815232b30145 => generated 1367 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:12:07.148553 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-add36769-540b-4b13-9677-27341cee1a95 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:12:07.149298 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-add36769-540b-4b13-9677-27341cee1a95 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] [instance: 81741be3-0961-4d2f-b011-815232b30145] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:12:07.156999 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-add36769-540b-4b13-9677-27341cee1a95 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:12:07.157304 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-add36769-540b-4b13-9677-27341cee1a95 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:12:07.158100 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-add36769-540b-4b13-9677-27341cee1a95 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:12:07.158534 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-add36769-540b-4b13-9677-27341cee1a95 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:12:07.350113 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-add36769-540b-4b13-9677-27341cee1a95 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac71714265342098d2487a701a6c364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f76a684261dd49f68a42a4e157355f37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:12:07.359100 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-add36769-540b-4b13-9677-27341cee1a95 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] 10.222.0.20 "GET /compute/v2.1/servers/81741be3-0961-4d2f-b011-815232b30145" status: 200 len: 1558 microversion: 2.1 time: 0.214364 Jul 01 04:12:07.359789 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 377/745] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:12:07 2022] GET /compute/v2.1/servers/81741be3-0961-4d2f-b011-815232b30145 => generated 1558 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:12:07.390327 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-05ce1a0d-e666-4aeb-b3a4-50616ca05470 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:12:07.391784 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-05ce1a0d-e666-4aeb-b3a4-50616ca05470 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] [instance: 81741be3-0961-4d2f-b011-815232b30145] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:12:07.404244 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-05ce1a0d-e666-4aeb-b3a4-50616ca05470 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:12:07.404986 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-05ce1a0d-e666-4aeb-b3a4-50616ca05470 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:12:07.405826 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-05ce1a0d-e666-4aeb-b3a4-50616ca05470 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:12:07.406906 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-05ce1a0d-e666-4aeb-b3a4-50616ca05470 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:12:07.549627 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-05ce1a0d-e666-4aeb-b3a4-50616ca05470 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] 10.222.0.20 "GET /compute/v2.1/servers/81741be3-0961-4d2f-b011-815232b30145/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.166485 Jul 01 04:12:07.550572 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 369/746] 10.222.0.20 () {58 vars in 1274 bytes} [Fri Jul 1 04:12:07 2022] GET /compute/v2.1/servers/81741be3-0961-4d2f-b011-815232b30145/os-interface => generated 285 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 04:12:08.732398 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [req-27d5383b-98cb-47d2-9691-6680445110fe req-3528d7af-b893-4be0-9890-369e9fc34491 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "81741be3-0961-4d2f-b011-815232b30145", "tag": "0ab24be8-5070-41c4-80ff-33402e762b2b"}]} {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 04:12:08.741971 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [req-27d5383b-98cb-47d2-9691-6680445110fe req-3528d7af-b893-4be0-9890-369e9fc34491 service nova] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:12:08.742433 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [req-27d5383b-98cb-47d2-9691-6680445110fe req-3528d7af-b893-4be0-9890-369e9fc34491 service nova] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:12:08.755325 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.compute.server_external_events [req-27d5383b-98cb-47d2-9691-6680445110fe req-3528d7af-b893-4be0-9890-369e9fc34491 service nova] Creating event network-changed:0ab24be8-5070-41c4-80ff-33402e762b2b for instance 81741be3-0961-4d2f-b011-815232b30145 on hv-cinder-84684 Jul 01 04:12:08.761538 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [req-27d5383b-98cb-47d2-9691-6680445110fe req-3528d7af-b893-4be0-9890-369e9fc34491 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033090 Jul 01 04:12:08.762176 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 378/747] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Jul 1 04:12:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 04:12:17.317008 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-5da0dc83-29a9-4b61-9f4a-6a319e06b372 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Action: 'create', calling method: .version_select at 0x7f99a080cee0>, body: {"keypair": {"name": "tempest-keypair-1836350763", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMFJt05M5lPn7SLu8kCNut9o0RHLsjZptBiRNe0W9E4gPGJwBOQG0G8+Z28DIDdKGbY6f9xrEeJR95vn/707Hcri7JNUw0I4fEnMb7OQQXE1Hi2Ndl0Bz48Ns+75MhVrpw=="}} {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 04:12:17.321430 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG dbcounter [-] [118711] Writing DB stats nova_api:SELECT=61,nova_api:INSERT=1 {{(pid=118711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:12:17.334113 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.quota [None req-5da0dc83-29a9-4b61-9f4a-6a319e06b372 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Getting quotas for project 9614129d1e864c3ea288aaac8387c5d1. Resources: {'key_pairs'} {{(pid=118711) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 04:12:17.338450 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.quota [None req-5da0dc83-29a9-4b61-9f4a-6a319e06b372 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Getting quotas for user 73d76a988462431fa6bb03dca64463a4 and project 9614129d1e864c3ea288aaac8387c5d1. Resources: {'key_pairs'} {{(pid=118711) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 04:12:17.439021 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG dbcounter [-] [118711] Writing DB stats nova_cell1:SELECT=95 {{(pid=118711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:12:17.450096 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-5da0dc83-29a9-4b61-9f4a-6a319e06b372 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.263738 Jul 01 04:12:17.450719 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 370/748] 10.222.0.20 () {60 vars in 1158 bytes} [Fri Jul 1 04:12:17 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 04:12:20.349433 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-f971c746-c829-4cfa-83d5-7fc0b456dcfc tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-79149415", "imageRef": "66f9f4ba-339c-4967-8857-d65299a66629", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c429d9e7-af70-440a-8720-43fe9c7d6353"}], "security_groups": [{"name": "tempest-securitygroup--1709112447"}], "key_name": "tempest-keypair-1836350763", "user_data": "}} {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 04:12:20.358508 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG dbcounter [-] [118712] Writing DB stats nova_api:SELECT=62,nova_api:INSERT=3,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=118712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:12:20.360021 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG dbcounter [-] [118712] Writing DB stats nova_cell1:SELECT=46 {{(pid=118712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:12:20.573019 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.network.neutron [None req-f971c746-c829-4cfa-83d5-7fc0b456dcfc tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] validate_networks() for [('c429d9e7-af70-440a-8720-43fe9c7d6353', None, None, None, None, None)] {{(pid=118712) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 01 04:12:21.105733 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.virt.hardware [None req-f971c746-c829-4cfa-83d5-7fc0b456dcfc tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Flavor limits 0:0:0 {{(pid=118712) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 01 04:12:21.106535 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.virt.hardware [None req-f971c746-c829-4cfa-83d5-7fc0b456dcfc tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Image limits 0:0:0 {{(pid=118712) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 01 04:12:21.107448 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.virt.hardware [None req-f971c746-c829-4cfa-83d5-7fc0b456dcfc tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Flavor pref 0:0:0 {{(pid=118712) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 01 04:12:21.108064 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.virt.hardware [None req-f971c746-c829-4cfa-83d5-7fc0b456dcfc tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Image pref 0:0:0 {{(pid=118712) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 01 04:12:21.108592 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.virt.hardware [None req-f971c746-c829-4cfa-83d5-7fc0b456dcfc tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118712) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 01 04:12:21.119616 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-f971c746-c829-4cfa-83d5-7fc0b456dcfc tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:12:21.120073 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-f971c746-c829-4cfa-83d5-7fc0b456dcfc tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:12:21.120918 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-f971c746-c829-4cfa-83d5-7fc0b456dcfc tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:12:21.121390 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-f971c746-c829-4cfa-83d5-7fc0b456dcfc tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:12:21.141402 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.quota [None req-f971c746-c829-4cfa-83d5-7fc0b456dcfc tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Getting quotas for project 9614129d1e864c3ea288aaac8387c5d1. Resources: {'ram', 'cores', 'instances'} {{(pid=118712) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 04:12:21.145812 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.quota [None req-f971c746-c829-4cfa-83d5-7fc0b456dcfc tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Getting quotas for user 73d76a988462431fa6bb03dca64463a4 and project 9614129d1e864c3ea288aaac8387c5d1. Resources: {'ram', 'cores', 'instances'} {{(pid=118712) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 04:12:21.159052 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-f971c746-c829-4cfa-83d5-7fc0b456dcfc tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Going to run 1 instances... {{(pid=118712) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 01 04:12:21.161691 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-f971c746-c829-4cfa-83d5-7fc0b456dcfc tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] [instance: 2e5d1edc-dbae-41dd-ab34-aa954b62f390] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='66f9f4ba-339c-4967-8857-d65299a66629',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118712) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 01 04:12:21.313651 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-f971c746-c829-4cfa-83d5-7fc0b456dcfc tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.968987 Jul 01 04:12:21.318474 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 379/749] 10.222.0.20 () {60 vars in 1146 bytes} [Fri Jul 1 04:12:20 2022] POST /compute/v2.1/servers => generated 402 bytes in 972 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 01 04:12:21.337714 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-b03365aa-9ff1-4f2d-98df-cb39042f3845 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:12:21.338334 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-b03365aa-9ff1-4f2d-98df-cb39042f3845 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] [instance: 2e5d1edc-dbae-41dd-ab34-aa954b62f390] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:12:21.424560 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-b03365aa-9ff1-4f2d-98df-cb39042f3845 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73d76a988462431fa6bb03dca64463a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9614129d1e864c3ea288aaac8387c5d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:12:21.438445 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-b03365aa-9ff1-4f2d-98df-cb39042f3845 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] 10.222.0.20 "GET /compute/v2.1/servers/2e5d1edc-dbae-41dd-ab34-aa954b62f390" status: 200 len: 1236 microversion: 2.1 time: 0.104942 Jul 01 04:12:21.443627 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 371/750] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:12:21 2022] GET /compute/v2.1/servers/2e5d1edc-dbae-41dd-ab34-aa954b62f390 => generated 1236 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:12:22.461469 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-b38ae73c-7f2f-4e31-936a-375fa8e75ac7 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:12:22.462233 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-b38ae73c-7f2f-4e31-936a-375fa8e75ac7 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] [instance: 2e5d1edc-dbae-41dd-ab34-aa954b62f390] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:12:22.525359 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-b38ae73c-7f2f-4e31-936a-375fa8e75ac7 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73d76a988462431fa6bb03dca64463a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9614129d1e864c3ea288aaac8387c5d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:12:22.536993 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-b38ae73c-7f2f-4e31-936a-375fa8e75ac7 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] 10.222.0.20 "GET /compute/v2.1/servers/2e5d1edc-dbae-41dd-ab34-aa954b62f390" status: 200 len: 1236 microversion: 2.1 time: 0.079523 Jul 01 04:12:22.537771 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 380/751] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:12:22 2022] GET /compute/v2.1/servers/2e5d1edc-dbae-41dd-ab34-aa954b62f390 => generated 1236 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:12:23.561443 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-b46f3acc-bb40-4ac3-b4bd-4081868d4463 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:12:23.562363 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-b46f3acc-bb40-4ac3-b4bd-4081868d4463 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] [instance: 2e5d1edc-dbae-41dd-ab34-aa954b62f390] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:12:23.570394 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-b46f3acc-bb40-4ac3-b4bd-4081868d4463 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:12:23.574818 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-b46f3acc-bb40-4ac3-b4bd-4081868d4463 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:12:23.574818 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-b46f3acc-bb40-4ac3-b4bd-4081868d4463 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:12:23.574818 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-b46f3acc-bb40-4ac3-b4bd-4081868d4463 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:12:23.657511 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-b46f3acc-bb40-4ac3-b4bd-4081868d4463 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73d76a988462431fa6bb03dca64463a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9614129d1e864c3ea288aaac8387c5d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:12:23.666279 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-b46f3acc-bb40-4ac3-b4bd-4081868d4463 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] 10.222.0.20 "GET /compute/v2.1/servers/2e5d1edc-dbae-41dd-ab34-aa954b62f390" status: 200 len: 1296 microversion: 2.1 time: 0.108726 Jul 01 04:12:23.666910 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 372/752] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:12:23 2022] GET /compute/v2.1/servers/2e5d1edc-dbae-41dd-ab34-aa954b62f390 => generated 1296 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:12:24.684395 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-b3b9faef-b678-4d04-aa0f-2819d1facba0 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:12:24.685128 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-b3b9faef-b678-4d04-aa0f-2819d1facba0 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] [instance: 2e5d1edc-dbae-41dd-ab34-aa954b62f390] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:12:24.694149 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-b3b9faef-b678-4d04-aa0f-2819d1facba0 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:12:24.694620 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-b3b9faef-b678-4d04-aa0f-2819d1facba0 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:12:24.695495 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-b3b9faef-b678-4d04-aa0f-2819d1facba0 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:12:24.695951 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-b3b9faef-b678-4d04-aa0f-2819d1facba0 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:12:24.897609 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-b3b9faef-b678-4d04-aa0f-2819d1facba0 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73d76a988462431fa6bb03dca64463a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9614129d1e864c3ea288aaac8387c5d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:12:24.912570 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-b3b9faef-b678-4d04-aa0f-2819d1facba0 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] 10.222.0.20 "GET /compute/v2.1/servers/2e5d1edc-dbae-41dd-ab34-aa954b62f390" status: 200 len: 1362 microversion: 2.1 time: 0.231783 Jul 01 04:12:24.927848 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 381/753] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:12:24 2022] GET /compute/v2.1/servers/2e5d1edc-dbae-41dd-ab34-aa954b62f390 => generated 1362 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 04:12:25.624171 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [req-277ca52d-2f63-4262-8abc-61f40dfb5cc3 req-fca7374f-8222-434d-b48b-d339d7729aff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2e5d1edc-dbae-41dd-ab34-aa954b62f390", "tag": "fc978023-4a63-4cbc-bcf9-4541918a2a6d"}]} {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 04:12:25.641378 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [req-277ca52d-2f63-4262-8abc-61f40dfb5cc3 req-fca7374f-8222-434d-b48b-d339d7729aff service nova] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:12:25.641864 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [req-277ca52d-2f63-4262-8abc-61f40dfb5cc3 req-fca7374f-8222-434d-b48b-d339d7729aff service nova] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:12:25.663952 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.compute.server_external_events [req-277ca52d-2f63-4262-8abc-61f40dfb5cc3 req-fca7374f-8222-434d-b48b-d339d7729aff service nova] Creating event network-changed:fc978023-4a63-4cbc-bcf9-4541918a2a6d for instance 2e5d1edc-dbae-41dd-ab34-aa954b62f390 on hv-cinder-84684 Jul 01 04:12:25.670865 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [req-277ca52d-2f63-4262-8abc-61f40dfb5cc3 req-fca7374f-8222-434d-b48b-d339d7729aff service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052101 Jul 01 04:12:25.671682 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 373/754] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Jul 1 04:12:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 04:12:25.940708 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-8c106608-9d62-4e4d-9789-96f506fa272a tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:12:25.941838 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-8c106608-9d62-4e4d-9789-96f506fa272a tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] [instance: 2e5d1edc-dbae-41dd-ab34-aa954b62f390] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:12:25.950746 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-8c106608-9d62-4e4d-9789-96f506fa272a tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:12:25.951432 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-8c106608-9d62-4e4d-9789-96f506fa272a tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:12:25.952324 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-8c106608-9d62-4e4d-9789-96f506fa272a tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:12:25.952937 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-8c106608-9d62-4e4d-9789-96f506fa272a tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:12:26.253245 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-8c106608-9d62-4e4d-9789-96f506fa272a tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73d76a988462431fa6bb03dca64463a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9614129d1e864c3ea288aaac8387c5d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:12:26.253245 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-8c106608-9d62-4e4d-9789-96f506fa272a tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] 10.222.0.20 "GET /compute/v2.1/servers/2e5d1edc-dbae-41dd-ab34-aa954b62f390" status: 200 len: 1362 microversion: 2.1 time: 0.209753 Jul 01 04:12:26.253245 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 382/755] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:12:25 2022] GET /compute/v2.1/servers/2e5d1edc-dbae-41dd-ab34-aa954b62f390 => generated 1362 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:12:27.165962 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-5ea1a42e-bf57-49c0-b1c6-f3b2667f38ba tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:12:27.166799 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-5ea1a42e-bf57-49c0-b1c6-f3b2667f38ba tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] [instance: 2e5d1edc-dbae-41dd-ab34-aa954b62f390] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:12:27.175336 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-5ea1a42e-bf57-49c0-b1c6-f3b2667f38ba tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:12:27.175974 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-5ea1a42e-bf57-49c0-b1c6-f3b2667f38ba tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:12:27.176807 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-5ea1a42e-bf57-49c0-b1c6-f3b2667f38ba tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:12:27.177289 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-5ea1a42e-bf57-49c0-b1c6-f3b2667f38ba tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:12:27.340098 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-5ea1a42e-bf57-49c0-b1c6-f3b2667f38ba tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73d76a988462431fa6bb03dca64463a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9614129d1e864c3ea288aaac8387c5d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:12:27.348163 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-5ea1a42e-bf57-49c0-b1c6-f3b2667f38ba tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] 10.222.0.20 "GET /compute/v2.1/servers/2e5d1edc-dbae-41dd-ab34-aa954b62f390" status: 200 len: 1362 microversion: 2.1 time: 0.187122 Jul 01 04:12:27.349857 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 374/756] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:12:27 2022] GET /compute/v2.1/servers/2e5d1edc-dbae-41dd-ab34-aa954b62f390 => generated 1362 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:12:28.366099 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-12966d6d-9a78-4cff-a027-95591ec5c15c tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:12:28.366996 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-12966d6d-9a78-4cff-a027-95591ec5c15c tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] [instance: 2e5d1edc-dbae-41dd-ab34-aa954b62f390] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:12:28.373697 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-12966d6d-9a78-4cff-a027-95591ec5c15c tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:12:28.374160 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-12966d6d-9a78-4cff-a027-95591ec5c15c tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:12:28.374948 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-12966d6d-9a78-4cff-a027-95591ec5c15c tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:12:28.375434 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-12966d6d-9a78-4cff-a027-95591ec5c15c tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:12:28.520936 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-12966d6d-9a78-4cff-a027-95591ec5c15c tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73d76a988462431fa6bb03dca64463a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9614129d1e864c3ea288aaac8387c5d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:12:28.528860 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-12966d6d-9a78-4cff-a027-95591ec5c15c tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] 10.222.0.20 "GET /compute/v2.1/servers/2e5d1edc-dbae-41dd-ab34-aa954b62f390" status: 200 len: 1362 microversion: 2.1 time: 0.166829 Jul 01 04:12:28.529454 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 383/757] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:12:28 2022] GET /compute/v2.1/servers/2e5d1edc-dbae-41dd-ab34-aa954b62f390 => generated 1362 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 04:12:29.547186 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-8428d9cc-d860-4bd5-bfbc-f4892614f498 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:12:29.547866 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-8428d9cc-d860-4bd5-bfbc-f4892614f498 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] [instance: 2e5d1edc-dbae-41dd-ab34-aa954b62f390] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:12:29.555409 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-8428d9cc-d860-4bd5-bfbc-f4892614f498 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:12:29.555875 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-8428d9cc-d860-4bd5-bfbc-f4892614f498 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:12:29.556692 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-8428d9cc-d860-4bd5-bfbc-f4892614f498 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:12:29.557182 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-8428d9cc-d860-4bd5-bfbc-f4892614f498 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:12:29.722193 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-8428d9cc-d860-4bd5-bfbc-f4892614f498 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73d76a988462431fa6bb03dca64463a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9614129d1e864c3ea288aaac8387c5d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:12:29.729991 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-8428d9cc-d860-4bd5-bfbc-f4892614f498 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] 10.222.0.20 "GET /compute/v2.1/servers/2e5d1edc-dbae-41dd-ab34-aa954b62f390" status: 200 len: 1362 microversion: 2.1 time: 0.187467 Jul 01 04:12:29.730581 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 375/758] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:12:29 2022] GET /compute/v2.1/servers/2e5d1edc-dbae-41dd-ab34-aa954b62f390 => generated 1362 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:12:30.747191 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-d2fa5b0d-444f-4c18-9406-6ae631774529 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:12:30.747875 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-d2fa5b0d-444f-4c18-9406-6ae631774529 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] [instance: 2e5d1edc-dbae-41dd-ab34-aa954b62f390] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:12:30.757960 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-d2fa5b0d-444f-4c18-9406-6ae631774529 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:12:30.758424 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-d2fa5b0d-444f-4c18-9406-6ae631774529 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:12:30.759248 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-d2fa5b0d-444f-4c18-9406-6ae631774529 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:12:30.759735 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-d2fa5b0d-444f-4c18-9406-6ae631774529 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:12:30.908702 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-d2fa5b0d-444f-4c18-9406-6ae631774529 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73d76a988462431fa6bb03dca64463a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9614129d1e864c3ea288aaac8387c5d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:12:30.921004 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-d2fa5b0d-444f-4c18-9406-6ae631774529 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] 10.222.0.20 "GET /compute/v2.1/servers/2e5d1edc-dbae-41dd-ab34-aa954b62f390" status: 200 len: 1362 microversion: 2.1 time: 0.177277 Jul 01 04:12:30.922309 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 384/759] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:12:30 2022] GET /compute/v2.1/servers/2e5d1edc-dbae-41dd-ab34-aa954b62f390 => generated 1362 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:12:31.876006 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [req-f193d065-8d08-4fdd-96f5-4156af183ca5 req-9583d01f-f5ad-466d-8822-6aa615affdf0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e5d1edc-dbae-41dd-ab34-aa954b62f390", "name": "network-vif-plugged", "status": "completed", "tag": "fc978023-4a63-4cbc-bcf9-4541918a2a6d"}]} {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 04:12:31.880617 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG dbcounter [-] [118711] Writing DB stats nova_cell0:SELECT=6 {{(pid=118711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:12:31.886425 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [req-f193d065-8d08-4fdd-96f5-4156af183ca5 req-9583d01f-f5ad-466d-8822-6aa615affdf0 service nova] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:12:31.886876 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [req-f193d065-8d08-4fdd-96f5-4156af183ca5 req-9583d01f-f5ad-466d-8822-6aa615affdf0 service nova] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:12:31.901845 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.compute.server_external_events [req-f193d065-8d08-4fdd-96f5-4156af183ca5 req-9583d01f-f5ad-466d-8822-6aa615affdf0 service nova] Creating event network-vif-plugged:fc978023-4a63-4cbc-bcf9-4541918a2a6d for instance 2e5d1edc-dbae-41dd-ab34-aa954b62f390 on hv-cinder-84684 Jul 01 04:12:31.908094 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [req-f193d065-8d08-4fdd-96f5-4156af183ca5 req-9583d01f-f5ad-466d-8822-6aa615affdf0 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039910 Jul 01 04:12:31.908769 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 376/760] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Jul 1 04:12:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 04:12:31.939151 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-6537b911-f21a-4585-a766-e2523eb27051 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:12:31.940118 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-6537b911-f21a-4585-a766-e2523eb27051 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] [instance: 2e5d1edc-dbae-41dd-ab34-aa954b62f390] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:12:31.942446 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG dbcounter [-] [118712] Writing DB stats nova_cell0:SELECT=2 {{(pid=118712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:12:31.950115 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-6537b911-f21a-4585-a766-e2523eb27051 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:12:31.950677 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-6537b911-f21a-4585-a766-e2523eb27051 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:12:31.952138 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-6537b911-f21a-4585-a766-e2523eb27051 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:12:31.953589 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-6537b911-f21a-4585-a766-e2523eb27051 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:12:32.110459 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-6537b911-f21a-4585-a766-e2523eb27051 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73d76a988462431fa6bb03dca64463a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9614129d1e864c3ea288aaac8387c5d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:12:32.122815 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-6537b911-f21a-4585-a766-e2523eb27051 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] 10.222.0.20 "GET /compute/v2.1/servers/2e5d1edc-dbae-41dd-ab34-aa954b62f390" status: 200 len: 1362 microversion: 2.1 time: 0.188425 Jul 01 04:12:32.123519 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 385/761] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:12:31 2022] GET /compute/v2.1/servers/2e5d1edc-dbae-41dd-ab34-aa954b62f390 => generated 1362 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:12:33.147155 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-16dfd564-8069-4c46-b344-ef6f709118a7 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:12:33.147883 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-16dfd564-8069-4c46-b344-ef6f709118a7 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] [instance: 2e5d1edc-dbae-41dd-ab34-aa954b62f390] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:12:33.154567 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-16dfd564-8069-4c46-b344-ef6f709118a7 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:12:33.155022 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-16dfd564-8069-4c46-b344-ef6f709118a7 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:12:33.156315 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-16dfd564-8069-4c46-b344-ef6f709118a7 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:12:33.156845 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-16dfd564-8069-4c46-b344-ef6f709118a7 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:12:33.292609 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-16dfd564-8069-4c46-b344-ef6f709118a7 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73d76a988462431fa6bb03dca64463a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9614129d1e864c3ea288aaac8387c5d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:12:33.302205 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-16dfd564-8069-4c46-b344-ef6f709118a7 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] 10.222.0.20 "GET /compute/v2.1/servers/2e5d1edc-dbae-41dd-ab34-aa954b62f390" status: 200 len: 1362 microversion: 2.1 time: 0.159574 Jul 01 04:12:33.302776 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 377/762] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:12:33 2022] GET /compute/v2.1/servers/2e5d1edc-dbae-41dd-ab34-aa954b62f390 => generated 1362 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:12:34.320682 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-d247ca8d-fe31-4470-9251-f740ca1a6a08 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:12:34.321207 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-d247ca8d-fe31-4470-9251-f740ca1a6a08 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] [instance: 2e5d1edc-dbae-41dd-ab34-aa954b62f390] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:12:34.323076 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG dbcounter [-] [118712] Writing DB stats nova_cell0:SELECT=8 {{(pid=118712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:12:34.329009 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-d247ca8d-fe31-4470-9251-f740ca1a6a08 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:12:34.329473 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-d247ca8d-fe31-4470-9251-f740ca1a6a08 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:12:34.330292 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-d247ca8d-fe31-4470-9251-f740ca1a6a08 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:12:34.330715 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-d247ca8d-fe31-4470-9251-f740ca1a6a08 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:12:34.468717 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-d247ca8d-fe31-4470-9251-f740ca1a6a08 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73d76a988462431fa6bb03dca64463a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9614129d1e864c3ea288aaac8387c5d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:12:34.476233 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-d247ca8d-fe31-4470-9251-f740ca1a6a08 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] 10.222.0.20 "GET /compute/v2.1/servers/2e5d1edc-dbae-41dd-ab34-aa954b62f390" status: 200 len: 1547 microversion: 2.1 time: 0.159852 Jul 01 04:12:34.476808 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 386/763] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:12:34 2022] GET /compute/v2.1/servers/2e5d1edc-dbae-41dd-ab34-aa954b62f390 => generated 1547 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:12:34.493045 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-0ceef467-ef9a-405f-afd6-a254a7567c93 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:12:34.493616 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-0ceef467-ef9a-405f-afd6-a254a7567c93 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] [instance: 2e5d1edc-dbae-41dd-ab34-aa954b62f390] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:12:34.500515 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-0ceef467-ef9a-405f-afd6-a254a7567c93 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:12:34.500968 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-0ceef467-ef9a-405f-afd6-a254a7567c93 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:12:34.501735 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-0ceef467-ef9a-405f-afd6-a254a7567c93 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:12:34.502221 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-0ceef467-ef9a-405f-afd6-a254a7567c93 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:12:34.581647 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-0ceef467-ef9a-405f-afd6-a254a7567c93 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] 10.222.0.20 "GET /compute/v2.1/servers/2e5d1edc-dbae-41dd-ab34-aa954b62f390/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.092296 Jul 01 04:12:34.585194 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 378/764] 10.222.0.20 () {58 vars in 1274 bytes} [Fri Jul 1 04:12:34 2022] GET /compute/v2.1/servers/2e5d1edc-dbae-41dd-ab34-aa954b62f390/os-interface => generated 284 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 04:12:35.880725 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [req-00f81f2c-9cdd-4778-a3a5-a770a2041966 req-747af9a0-41be-4de4-aeb9-8c636c4b127a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2e5d1edc-dbae-41dd-ab34-aa954b62f390", "tag": "fc978023-4a63-4cbc-bcf9-4541918a2a6d"}]} {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 04:12:35.889444 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [req-00f81f2c-9cdd-4778-a3a5-a770a2041966 req-747af9a0-41be-4de4-aeb9-8c636c4b127a service nova] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:12:35.890448 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [req-00f81f2c-9cdd-4778-a3a5-a770a2041966 req-747af9a0-41be-4de4-aeb9-8c636c4b127a service nova] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:12:35.902110 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.compute.server_external_events [req-00f81f2c-9cdd-4778-a3a5-a770a2041966 req-747af9a0-41be-4de4-aeb9-8c636c4b127a service nova] Creating event network-changed:fc978023-4a63-4cbc-bcf9-4541918a2a6d for instance 2e5d1edc-dbae-41dd-ab34-aa954b62f390 on hv-cinder-84684 Jul 01 04:12:35.908208 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [req-00f81f2c-9cdd-4778-a3a5-a770a2041966 req-747af9a0-41be-4de4-aeb9-8c636c4b127a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031248 Jul 01 04:12:35.908819 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 387/765] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Jul 1 04:12:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 04:12:45.008527 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG dbcounter [-] [118711] Writing DB stats nova_api:SELECT=28,nova_api:INSERT=1 {{(pid=118711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:12:45.009285 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG dbcounter [-] [118711] Writing DB stats nova_cell1:SELECT=32 {{(pid=118711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:12:45.013245 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-acb30995-c55f-4e5a-8850-5b3647119d7a tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:12:45.013743 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-acb30995-c55f-4e5a-8850-5b3647119d7a tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] [instance: 81741be3-0961-4d2f-b011-815232b30145] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:12:45.019827 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-acb30995-c55f-4e5a-8850-5b3647119d7a tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:12:45.021773 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-acb30995-c55f-4e5a-8850-5b3647119d7a tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:12:45.021773 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-acb30995-c55f-4e5a-8850-5b3647119d7a tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:12:45.021773 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-acb30995-c55f-4e5a-8850-5b3647119d7a tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:12:45.051429 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-acb30995-c55f-4e5a-8850-5b3647119d7a tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] 10.222.0.20 "GET /compute/v2.1/servers/81741be3-0961-4d2f-b011-815232b30145/ips" status: 200 len: 150 microversion: 2.1 time: 0.044362 Jul 01 04:12:45.052053 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 379/766] 10.222.0.20 () {58 vars in 1247 bytes} [Fri Jul 1 04:12:45 2022] GET /compute/v2.1/servers/81741be3-0961-4d2f-b011-815232b30145/ips => generated 150 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 04:12:45.064403 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-c97b442a-c212-4631-bb7b-ad3acfc571cb tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e7e9b3f8-2c68-4ff0-a1d9-64ba653623e4"}} {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 04:12:45.065574 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-c97b442a-c212-4631-bb7b-ad3acfc571cb tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] [instance: 81741be3-0961-4d2f-b011-815232b30145] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:12:45.072274 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-c97b442a-c212-4631-bb7b-ad3acfc571cb tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:12:45.073391 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-c97b442a-c212-4631-bb7b-ad3acfc571cb tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:12:45.073681 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-c97b442a-c212-4631-bb7b-ad3acfc571cb tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:12:45.073912 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-c97b442a-c212-4631-bb7b-ad3acfc571cb tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:12:45.161870 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.wsgi [None req-c97b442a-c212-4631-bb7b-ad3acfc571cb tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] HTTP exception thrown: Invalid volume: volume e7e9b3f8-2c68-4ff0-a1d9-64ba653623e4 is already attached to instances: 8e620fdf-cea4-431c-abd4-006a5dd37f88 Jul 01 04:12:45.163821 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-c97b442a-c212-4631-bb7b-ad3acfc571cb tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Request method failure captured: Jul 01 04:12:45.163821 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: request: POST /compute/v2.1/servers/81741be3-0961-4d2f-b011-815232b30145/os-volume_attachments HTTP/1.1 Jul 01 04:12:45.163821 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: Accept: application/json Jul 01 04:12:45.163821 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: Accept-Encoding: identity Jul 01 04:12:45.163821 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: Connection: close Jul 01 04:12:45.163821 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: Content-Length: 74 Jul 01 04:12:45.163821 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: Content-Type: application/json Jul 01 04:12:45.163821 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: Host: 10.222.0.20 Jul 01 04:12:45.163821 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: Openstack-System-Scope: None Jul 01 04:12:45.163821 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: User-Agent: python-urllib3/1.26.9 Jul 01 04:12:45.163821 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Auth-Token: gAAAAABivnO_2SHspn5040vH8P4vp6P_nHqsfbY2b8BaTxMU37E-Nm1nW3UiPrXBDY7TPTOcTyJxuvdXyhrWNFcAJgF991L1LL3g9HBHqdiHQSEKxKFPESilMhAE3M7664WhTBceQb5njdTfXXYCgJ_rjpGbTLpsJzn6ZaZQDIGWFCb9NOvUG5w Jul 01 04:12:45.163821 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Domain-Id: None Jul 01 04:12:45.163821 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Domain-Name: None Jul 01 04:12:45.163821 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Identity-Status: Confirmed Jul 01 04:12:45.163821 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Is-Admin-Project: True Jul 01 04:12:45.163821 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Project-Domain-Id: default Jul 01 04:12:45.163821 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Project-Domain-Name: Default Jul 01 04:12:45.163821 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Project-Id: f76a684261dd49f68a42a4e157355f37 Jul 01 04:12:45.163821 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Project-Name: tempest-AttachVolumeNegativeTest-1321993683 Jul 01 04:12:45.163821 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Role: reader,member Jul 01 04:12:45.163821 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Roles: reader,member Jul 01 04:12:45.165535 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/f76a684261dd49f68a42a4e157355f37"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_f76a684261dd49f68a42a4e157355f37", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f76a684261dd49f68a42a4e157355f37"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f76a684261dd49f68a42a4e157355f37"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}] Jul 01 04:12:45.165535 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Tenant: tempest-AttachVolumeNegativeTest-1321993683 Jul 01 04:12:45.165535 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Tenant-Id: f76a684261dd49f68a42a4e157355f37 Jul 01 04:12:45.165535 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1321993683 Jul 01 04:12:45.165535 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-User: tempest-AttachVolumeNegativeTest-1321993683-project Jul 01 04:12:45.165535 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-User-Domain-Id: default Jul 01 04:12:45.165535 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-User-Domain-Name: Default Jul 01 04:12:45.165535 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-User-Id: 4ac71714265342098d2487a701a6c364 Jul 01 04:12:45.165535 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-User-Name: tempest-AttachVolumeNegativeTest-1321993683-project Jul 01 04:12:45.165535 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: Jul 01 04:12:45.165535 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: {"volumeAttachment": {"volumeId": "e7e9b3f8-2c68-4ff0-a1d9-64ba653623e4"}} Jul 01 04:12:45.165535 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: method: > Jul 01 04:12:45.166560 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: exception: Invalid volume: volume e7e9b3f8-2c68-4ff0-a1d9-64ba653623e4 is already attached to instances: 8e620fdf-cea4-431c-abd4-006a5dd37f88 Jul 01 04:12:45.166560 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: action_args: {'server_id': '81741be3-0961-4d2f-b011-815232b30145', 'body': {'volumeAttachment': {'volumeId': 'e7e9b3f8-2c68-4ff0-a1d9-64ba653623e4'}}} Jul 01 04:12:45.166560 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 04:12:45.166560 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 04:12:45.166560 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 01 04:12:45.166560 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 01 04:12:45.166560 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 01 04:12:45.166560 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 01 04:12:45.166560 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 01 04:12:45.166560 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 01 04:12:45.166560 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jul 01 04:12:45.166560 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 01 04:12:45.166560 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jul 01 04:12:45.166560 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 01 04:12:45.166560 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume e7e9b3f8-2c68-4ff0-a1d9-64ba653623e4 is already attached to instances: 8e620fdf-cea4-431c-abd4-006a5dd37f88 Jul 01 04:12:45.166560 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi Jul 01 04:12:45.166560 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 04:12:45.166560 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi Jul 01 04:12:45.166560 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 04:12:45.168493 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 04:12:45.168493 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 04:12:45.168493 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 04:12:45.168493 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 04:12:45.168493 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 04:12:45.168493 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 04:12:45.168493 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 01 04:12:45.168493 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 01 04:12:45.168493 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 01 04:12:45.168493 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 01 04:12:45.168493 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 01 04:12:45.168493 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 01 04:12:45.168493 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 01 04:12:45.168493 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 01 04:12:45.168493 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume e7e9b3f8-2c68-4ff0-a1d9-64ba653623e4 is already attached to instances: 8e620fdf-cea4-431c-abd4-006a5dd37f88 Jul 01 04:12:45.168493 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi Jul 01 04:12:45.168493 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 04:12:45.168493 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi Jul 01 04:12:45.168493 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 04:12:45.168493 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 04:12:45.170125 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 04:12:45.170125 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 04:12:45.170125 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 04:12:45.170125 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume e7e9b3f8-2c68-4ff0-a1d9-64ba653623e4 is already attached to instances: 8e620fdf-cea4-431c-abd4-006a5dd37f88 Jul 01 04:12:45.170125 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi Jul 01 04:12:45.170125 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-c97b442a-c212-4631-bb7b-ad3acfc571cb tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Returning 400 to user: Invalid volume: volume e7e9b3f8-2c68-4ff0-a1d9-64ba653623e4 is already attached to instances: 8e620fdf-cea4-431c-abd4-006a5dd37f88 {{(pid=118712) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 04:12:45.170125 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-c97b442a-c212-4631-bb7b-ad3acfc571cb tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] 10.222.0.20 "POST /compute/v2.1/servers/81741be3-0961-4d2f-b011-815232b30145/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.106336 Jul 01 04:12:45.170125 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 388/767] 10.222.0.20 () {60 vars in 1322 bytes} [Fri Jul 1 04:12:45 2022] POST /compute/v2.1/servers/81741be3-0961-4d2f-b011-815232b30145/os-volume_attachments => generated 174 bytes in 108 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 01 04:12:45.176767 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-e97f3153-c716-4ec9-88e0-a96220690664 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:12:45.177383 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-e97f3153-c716-4ec9-88e0-a96220690664 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] [instance: 81741be3-0961-4d2f-b011-815232b30145] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:12:45.185230 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-e97f3153-c716-4ec9-88e0-a96220690664 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:12:45.185718 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-e97f3153-c716-4ec9-88e0-a96220690664 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:12:45.186531 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-e97f3153-c716-4ec9-88e0-a96220690664 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:12:45.187002 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-e97f3153-c716-4ec9-88e0-a96220690664 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:12:45.230777 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-e97f3153-c716-4ec9-88e0-a96220690664 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] [instance: 81741be3-0961-4d2f-b011-815232b30145] Going to try to terminate instance {{(pid=118711) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 01 04:12:45.699029 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-e97f3153-c716-4ec9-88e0-a96220690664 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] 10.222.0.20 "DELETE /compute/v2.1/servers/81741be3-0961-4d2f-b011-815232b30145" status: 204 len: 0 microversion: 2.1 time: 0.527726 Jul 01 04:12:45.699686 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 380/768] 10.222.0.20 () {58 vars in 1238 bytes} [Fri Jul 1 04:12:45 2022] DELETE /compute/v2.1/servers/81741be3-0961-4d2f-b011-815232b30145 => generated 0 bytes in 529 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 01 04:12:45.721484 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-017f9de5-4ee7-4e71-8781-6a8fd2025818 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:12:45.722120 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-017f9de5-4ee7-4e71-8781-6a8fd2025818 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] [instance: 81741be3-0961-4d2f-b011-815232b30145] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:12:45.729534 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-017f9de5-4ee7-4e71-8781-6a8fd2025818 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:12:45.729988 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-017f9de5-4ee7-4e71-8781-6a8fd2025818 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:12:45.730955 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-017f9de5-4ee7-4e71-8781-6a8fd2025818 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:12:45.732787 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-017f9de5-4ee7-4e71-8781-6a8fd2025818 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:12:45.876587 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-017f9de5-4ee7-4e71-8781-6a8fd2025818 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac71714265342098d2487a701a6c364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f76a684261dd49f68a42a4e157355f37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:12:45.884306 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-017f9de5-4ee7-4e71-8781-6a8fd2025818 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] 10.222.0.20 "GET /compute/v2.1/servers/81741be3-0961-4d2f-b011-815232b30145" status: 200 len: 1682 microversion: 2.1 time: 0.167669 Jul 01 04:12:45.884888 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 389/769] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:12:45 2022] GET /compute/v2.1/servers/81741be3-0961-4d2f-b011-815232b30145 => generated 1682 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:12:46.903385 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-872b706e-1a42-4986-8ba4-ed61058898db tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:12:46.904276 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-872b706e-1a42-4986-8ba4-ed61058898db tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] [instance: 81741be3-0961-4d2f-b011-815232b30145] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:12:46.911169 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-872b706e-1a42-4986-8ba4-ed61058898db tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:12:46.911650 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-872b706e-1a42-4986-8ba4-ed61058898db tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:12:46.912540 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-872b706e-1a42-4986-8ba4-ed61058898db tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:12:46.912971 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-872b706e-1a42-4986-8ba4-ed61058898db tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:12:47.055086 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-872b706e-1a42-4986-8ba4-ed61058898db tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac71714265342098d2487a701a6c364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f76a684261dd49f68a42a4e157355f37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:12:47.063995 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-872b706e-1a42-4986-8ba4-ed61058898db tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] 10.222.0.20 "GET /compute/v2.1/servers/81741be3-0961-4d2f-b011-815232b30145" status: 200 len: 1682 microversion: 2.1 time: 0.165313 Jul 01 04:12:47.064578 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 381/770] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:12:46 2022] GET /compute/v2.1/servers/81741be3-0961-4d2f-b011-815232b30145 => generated 1682 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:12:48.082526 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-b6996372-e324-41ac-88e2-067751257852 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:12:48.083149 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-b6996372-e324-41ac-88e2-067751257852 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] [instance: 81741be3-0961-4d2f-b011-815232b30145] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:12:48.089895 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-b6996372-e324-41ac-88e2-067751257852 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:12:48.090263 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-b6996372-e324-41ac-88e2-067751257852 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:12:48.091325 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-b6996372-e324-41ac-88e2-067751257852 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:12:48.091582 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-b6996372-e324-41ac-88e2-067751257852 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:12:48.161774 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-b6996372-e324-41ac-88e2-067751257852 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac71714265342098d2487a701a6c364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f76a684261dd49f68a42a4e157355f37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:12:48.170338 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-b6996372-e324-41ac-88e2-067751257852 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] 10.222.0.20 "GET /compute/v2.1/servers/81741be3-0961-4d2f-b011-815232b30145" status: 200 len: 1614 microversion: 2.1 time: 0.092450 Jul 01 04:12:48.170915 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 390/771] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:12:48 2022] GET /compute/v2.1/servers/81741be3-0961-4d2f-b011-815232b30145 => generated 1614 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 04:12:48.378597 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [req-387aff04-122c-4174-9750-dd313751d819 req-c1e593c7-dcc2-49c8-a1bf-a729dcbf16d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "81741be3-0961-4d2f-b011-815232b30145", "name": "network-vif-deleted", "tag": "0ab24be8-5070-41c4-80ff-33402e762b2b"}]} {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 04:12:48.387433 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [req-387aff04-122c-4174-9750-dd313751d819 req-c1e593c7-dcc2-49c8-a1bf-a729dcbf16d4 service nova] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:12:48.387860 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [req-387aff04-122c-4174-9750-dd313751d819 req-c1e593c7-dcc2-49c8-a1bf-a729dcbf16d4 service nova] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:12:48.399281 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.compute.server_external_events [req-387aff04-122c-4174-9750-dd313751d819 req-c1e593c7-dcc2-49c8-a1bf-a729dcbf16d4 service nova] Creating event network-vif-deleted:0ab24be8-5070-41c4-80ff-33402e762b2b for instance 81741be3-0961-4d2f-b011-815232b30145 on hv-cinder-84684 Jul 01 04:12:48.404216 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [req-387aff04-122c-4174-9750-dd313751d819 req-c1e593c7-dcc2-49c8-a1bf-a729dcbf16d4 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029827 Jul 01 04:12:48.404888 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 382/772] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Jul 1 04:12:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 04:12:49.188080 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-af88d4cd-affd-4c02-a50d-7b05dacad886 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:12:49.188680 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-af88d4cd-affd-4c02-a50d-7b05dacad886 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] [instance: 81741be3-0961-4d2f-b011-815232b30145] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:12:49.202792 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-af88d4cd-affd-4c02-a50d-7b05dacad886 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:12:49.203285 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-af88d4cd-affd-4c02-a50d-7b05dacad886 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:12:49.204351 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-af88d4cd-affd-4c02-a50d-7b05dacad886 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:12:49.204893 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-af88d4cd-affd-4c02-a50d-7b05dacad886 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:12:49.246047 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-af88d4cd-affd-4c02-a50d-7b05dacad886 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:12:49.246403 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-af88d4cd-affd-4c02-a50d-7b05dacad886 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:12:49.246866 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.objects.instance [None req-af88d4cd-affd-4c02-a50d-7b05dacad886 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lazy-loading 'fault' on Instance uuid 81741be3-0961-4d2f-b011-815232b30145 {{(pid=118712) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 04:12:49.304107 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-af88d4cd-affd-4c02-a50d-7b05dacad886 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac71714265342098d2487a701a6c364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f76a684261dd49f68a42a4e157355f37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:12:49.314385 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-af88d4cd-affd-4c02-a50d-7b05dacad886 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] 10.222.0.20 "GET /compute/v2.1/servers/81741be3-0961-4d2f-b011-815232b30145" status: 200 len: 1331 microversion: 2.1 time: 0.130095 Jul 01 04:12:49.321608 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 391/773] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:12:49 2022] GET /compute/v2.1/servers/81741be3-0961-4d2f-b011-815232b30145 => generated 1331 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:12:50.336779 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-c8cb1966-3581-4acb-957a-74159177c0db tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:12:50.337487 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-c8cb1966-3581-4acb-957a-74159177c0db tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] [instance: 81741be3-0961-4d2f-b011-815232b30145] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:12:50.344175 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-c8cb1966-3581-4acb-957a-74159177c0db tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:12:50.344711 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-c8cb1966-3581-4acb-957a-74159177c0db tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:12:50.345556 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-c8cb1966-3581-4acb-957a-74159177c0db tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:12:50.346044 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-c8cb1966-3581-4acb-957a-74159177c0db tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:12:50.360768 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.wsgi [None req-c8cb1966-3581-4acb-957a-74159177c0db tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] HTTP exception thrown: Instance 81741be3-0961-4d2f-b011-815232b30145 could not be found. Jul 01 04:12:50.362457 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-c8cb1966-3581-4acb-957a-74159177c0db tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Request method failure captured: Jul 01 04:12:50.362457 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: request: GET /compute/v2.1/servers/81741be3-0961-4d2f-b011-815232b30145 HTTP/1.1 Jul 01 04:12:50.362457 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: Accept: application/json Jul 01 04:12:50.362457 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: Accept-Encoding: identity Jul 01 04:12:50.362457 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: Connection: close Jul 01 04:12:50.362457 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: Content-Length: 0 Jul 01 04:12:50.362457 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: Content-Type: application/json Jul 01 04:12:50.362457 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: Host: 10.222.0.20 Jul 01 04:12:50.362457 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: Openstack-System-Scope: None Jul 01 04:12:50.362457 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: User-Agent: python-urllib3/1.26.9 Jul 01 04:12:50.362457 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-Auth-Token: gAAAAABivnO_2SHspn5040vH8P4vp6P_nHqsfbY2b8BaTxMU37E-Nm1nW3UiPrXBDY7TPTOcTyJxuvdXyhrWNFcAJgF991L1LL3g9HBHqdiHQSEKxKFPESilMhAE3M7664WhTBceQb5njdTfXXYCgJ_rjpGbTLpsJzn6ZaZQDIGWFCb9NOvUG5w Jul 01 04:12:50.362457 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-Domain-Id: None Jul 01 04:12:50.362457 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-Domain-Name: None Jul 01 04:12:50.362457 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-Identity-Status: Confirmed Jul 01 04:12:50.362457 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-Is-Admin-Project: True Jul 01 04:12:50.362457 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-Project-Domain-Id: default Jul 01 04:12:50.362457 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-Project-Domain-Name: Default Jul 01 04:12:50.362457 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-Project-Id: f76a684261dd49f68a42a4e157355f37 Jul 01 04:12:50.362457 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-Project-Name: tempest-AttachVolumeNegativeTest-1321993683 Jul 01 04:12:50.362457 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-Role: reader,member Jul 01 04:12:50.362457 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-Roles: reader,member Jul 01 04:12:50.364096 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/f76a684261dd49f68a42a4e157355f37"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_f76a684261dd49f68a42a4e157355f37", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f76a684261dd49f68a42a4e157355f37"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f76a684261dd49f68a42a4e157355f37"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}] Jul 01 04:12:50.364096 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-Tenant: tempest-AttachVolumeNegativeTest-1321993683 Jul 01 04:12:50.364096 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-Tenant-Id: f76a684261dd49f68a42a4e157355f37 Jul 01 04:12:50.364096 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1321993683 Jul 01 04:12:50.364096 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-User: tempest-AttachVolumeNegativeTest-1321993683-project Jul 01 04:12:50.364096 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-User-Domain-Id: default Jul 01 04:12:50.364096 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-User-Domain-Name: Default Jul 01 04:12:50.364096 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-User-Id: 4ac71714265342098d2487a701a6c364 Jul 01 04:12:50.364096 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-User-Name: tempest-AttachVolumeNegativeTest-1321993683-project Jul 01 04:12:50.364096 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: method: > Jul 01 04:12:50.364096 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: exception: Instance 81741be3-0961-4d2f-b011-815232b30145 could not be found. Jul 01 04:12:50.364096 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: action_args: {'id': '81741be3-0961-4d2f-b011-815232b30145'} Jul 01 04:12:50.368330 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 04:12:50.368330 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 04:12:50.368330 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 04:12:50.368330 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 04:12:50.368330 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 04:12:50.368330 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 04:12:50.368330 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 04:12:50.368330 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 04:12:50.368330 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 04:12:50.368330 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 04:12:50.368330 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 81741be3-0961-4d2f-b011-815232b30145 could not be found. Jul 01 04:12:50.368330 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi Jul 01 04:12:50.368330 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 04:12:50.368330 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi Jul 01 04:12:50.368330 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 04:12:50.368330 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 04:12:50.368330 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 04:12:50.368330 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 04:12:50.368330 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 04:12:50.368330 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 04:12:50.369837 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 04:12:50.369837 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 04:12:50.369837 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 04:12:50.369837 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 04:12:50.369837 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 04:12:50.369837 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 04:12:50.369837 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 04:12:50.369837 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 81741be3-0961-4d2f-b011-815232b30145 could not be found. Jul 01 04:12:50.369837 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi Jul 01 04:12:50.369837 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 04:12:50.369837 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi Jul 01 04:12:50.369837 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 04:12:50.369837 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 04:12:50.369837 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 04:12:50.369837 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 04:12:50.369837 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 04:12:50.369837 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 81741be3-0961-4d2f-b011-815232b30145 could not be found. Jul 01 04:12:50.369837 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi Jul 01 04:12:50.371158 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-c8cb1966-3581-4acb-957a-74159177c0db tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Returning 404 to user: Instance 81741be3-0961-4d2f-b011-815232b30145 could not be found. {{(pid=118711) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 04:12:50.371158 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-c8cb1966-3581-4acb-957a-74159177c0db tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] 10.222.0.20 "GET /compute/v2.1/servers/81741be3-0961-4d2f-b011-815232b30145" status: 404 len: 111 microversion: 2.1 time: 0.031923 Jul 01 04:12:50.371158 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 383/774] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:12:50 2022] GET /compute/v2.1/servers/81741be3-0961-4d2f-b011-815232b30145 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 04:12:50.378317 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-79bc9692-4006-44d1-bbd3-3e9a45a44736 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Calling method '.version_select at 0x7f99a073d1f0>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:12:50.506337 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-79bc9692-4006-44d1-bbd3-3e9a45a44736 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-283043856" status: 202 len: 0 microversion: 2.1 time: 0.132284 Jul 01 04:12:50.506933 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 392/775] 10.222.0.20 () {58 vars in 1217 bytes} [Fri Jul 1 04:12:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-283043856 => generated 0 bytes in 134 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 04:12:51.600926 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-ec1befd3-093b-479d-bb7b-0236b34c40ed tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:12:51.601510 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-ec1befd3-093b-479d-bb7b-0236b34c40ed tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] [instance: 8e620fdf-cea4-431c-abd4-006a5dd37f88] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:12:51.608082 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-ec1befd3-093b-479d-bb7b-0236b34c40ed tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:12:51.609123 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-ec1befd3-093b-479d-bb7b-0236b34c40ed tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:12:51.609903 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-ec1befd3-093b-479d-bb7b-0236b34c40ed tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:12:51.610341 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-ec1befd3-093b-479d-bb7b-0236b34c40ed tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:12:51.695415 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.objects.instance [None req-ec1befd3-093b-479d-bb7b-0236b34c40ed tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lazy-loading 'services' on Instance uuid 8e620fdf-cea4-431c-abd4-006a5dd37f88 {{(pid=118711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 04:12:51.943672 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-ec1befd3-093b-479d-bb7b-0236b34c40ed tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] 10.222.0.20 "DELETE /compute/v2.1/servers/8e620fdf-cea4-431c-abd4-006a5dd37f88/os-volume_attachments/e7e9b3f8-2c68-4ff0-a1d9-64ba653623e4" status: 202 len: 0 microversion: 2.1 time: 0.346538 Jul 01 04:12:51.944266 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 384/776] 10.222.0.20 () {58 vars in 1415 bytes} [Fri Jul 1 04:12:51 2022] DELETE /compute/v2.1/servers/8e620fdf-cea4-431c-abd4-006a5dd37f88/os-volume_attachments/e7e9b3f8-2c68-4ff0-a1d9-64ba653623e4 => generated 0 bytes in 348 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 04:12:51.953305 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-630b044b-937d-4a7d-8358-a0a60b3df735 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:12:51.954419 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-630b044b-937d-4a7d-8358-a0a60b3df735 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] [instance: 8e620fdf-cea4-431c-abd4-006a5dd37f88] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:12:51.956483 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG dbcounter [-] [118712] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=118712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:12:51.962694 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-630b044b-937d-4a7d-8358-a0a60b3df735 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:12:51.963147 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-630b044b-937d-4a7d-8358-a0a60b3df735 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:12:51.963972 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-630b044b-937d-4a7d-8358-a0a60b3df735 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:12:51.964471 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-630b044b-937d-4a7d-8358-a0a60b3df735 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:12:51.967027 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG dbcounter [-] [118712] Writing DB stats nova_cell1:SELECT=67 {{(pid=118712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:12:51.997837 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-630b044b-937d-4a7d-8358-a0a60b3df735 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] 10.222.0.20 "GET /compute/v2.1/servers/8e620fdf-cea4-431c-abd4-006a5dd37f88/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049079 Jul 01 04:12:51.998464 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 393/777] 10.222.0.20 () {58 vars in 1301 bytes} [Fri Jul 1 04:12:51 2022] GET /compute/v2.1/servers/8e620fdf-cea4-431c-abd4-006a5dd37f88/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 04:12:53.011335 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-1292b231-c965-46dd-9887-132ec0e861f1 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:12:53.012377 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-1292b231-c965-46dd-9887-132ec0e861f1 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] [instance: 8e620fdf-cea4-431c-abd4-006a5dd37f88] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:12:53.018771 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-1292b231-c965-46dd-9887-132ec0e861f1 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:12:53.019251 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-1292b231-c965-46dd-9887-132ec0e861f1 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:12:53.023423 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-1292b231-c965-46dd-9887-132ec0e861f1 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:12:53.023423 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-1292b231-c965-46dd-9887-132ec0e861f1 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:12:53.053206 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-1292b231-c965-46dd-9887-132ec0e861f1 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] 10.222.0.20 "GET /compute/v2.1/servers/8e620fdf-cea4-431c-abd4-006a5dd37f88/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046803 Jul 01 04:12:53.053884 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 385/778] 10.222.0.20 () {58 vars in 1301 bytes} [Fri Jul 1 04:12:53 2022] GET /compute/v2.1/servers/8e620fdf-cea4-431c-abd4-006a5dd37f88/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 01 04:12:53.113059 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-15bd0a3b-fe89-46c8-9d19-998994f201f5 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:12:53.113656 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-15bd0a3b-fe89-46c8-9d19-998994f201f5 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] [instance: 8e620fdf-cea4-431c-abd4-006a5dd37f88] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:12:53.121229 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-15bd0a3b-fe89-46c8-9d19-998994f201f5 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:12:53.121693 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-15bd0a3b-fe89-46c8-9d19-998994f201f5 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:12:53.122488 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-15bd0a3b-fe89-46c8-9d19-998994f201f5 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:12:53.122917 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-15bd0a3b-fe89-46c8-9d19-998994f201f5 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:12:53.148274 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-15bd0a3b-fe89-46c8-9d19-998994f201f5 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] [instance: 8e620fdf-cea4-431c-abd4-006a5dd37f88] Going to try to terminate instance {{(pid=118712) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 01 04:12:53.458721 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-15bd0a3b-fe89-46c8-9d19-998994f201f5 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] 10.222.0.20 "DELETE /compute/v2.1/servers/8e620fdf-cea4-431c-abd4-006a5dd37f88" status: 204 len: 0 microversion: 2.1 time: 0.349652 Jul 01 04:12:53.459344 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 394/779] 10.222.0.20 () {58 vars in 1238 bytes} [Fri Jul 1 04:12:53 2022] DELETE /compute/v2.1/servers/8e620fdf-cea4-431c-abd4-006a5dd37f88 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 01 04:12:53.467562 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-35e50ff7-adb3-4bd3-be89-c66053183ba0 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:12:53.468684 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-35e50ff7-adb3-4bd3-be89-c66053183ba0 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] [instance: 8e620fdf-cea4-431c-abd4-006a5dd37f88] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:12:53.474796 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-35e50ff7-adb3-4bd3-be89-c66053183ba0 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:12:53.475285 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-35e50ff7-adb3-4bd3-be89-c66053183ba0 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:12:53.476061 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-35e50ff7-adb3-4bd3-be89-c66053183ba0 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:12:53.476507 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-35e50ff7-adb3-4bd3-be89-c66053183ba0 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:12:53.618289 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-35e50ff7-adb3-4bd3-be89-c66053183ba0 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac71714265342098d2487a701a6c364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f76a684261dd49f68a42a4e157355f37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:12:53.626148 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-35e50ff7-adb3-4bd3-be89-c66053183ba0 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] 10.222.0.20 "GET /compute/v2.1/servers/8e620fdf-cea4-431c-abd4-006a5dd37f88" status: 200 len: 1680 microversion: 2.1 time: 0.162539 Jul 01 04:12:53.626765 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 386/780] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:12:53 2022] GET /compute/v2.1/servers/8e620fdf-cea4-431c-abd4-006a5dd37f88 => generated 1680 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:12:54.644589 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-22147f6a-1914-470a-ae25-92d914416331 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:12:54.645298 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-22147f6a-1914-470a-ae25-92d914416331 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] [instance: 8e620fdf-cea4-431c-abd4-006a5dd37f88] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:12:54.652079 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-22147f6a-1914-470a-ae25-92d914416331 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:12:54.652541 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-22147f6a-1914-470a-ae25-92d914416331 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:12:54.653327 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-22147f6a-1914-470a-ae25-92d914416331 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:12:54.653770 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-22147f6a-1914-470a-ae25-92d914416331 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:12:54.790259 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-22147f6a-1914-470a-ae25-92d914416331 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac71714265342098d2487a701a6c364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f76a684261dd49f68a42a4e157355f37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:12:54.798433 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-22147f6a-1914-470a-ae25-92d914416331 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] 10.222.0.20 "GET /compute/v2.1/servers/8e620fdf-cea4-431c-abd4-006a5dd37f88" status: 200 len: 1680 microversion: 2.1 time: 0.158271 Jul 01 04:12:54.799008 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 395/781] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:12:54 2022] GET /compute/v2.1/servers/8e620fdf-cea4-431c-abd4-006a5dd37f88 => generated 1680 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:12:55.815945 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-47101b5c-9597-4422-a9b9-7f885b21be77 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:12:55.816578 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-47101b5c-9597-4422-a9b9-7f885b21be77 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] [instance: 8e620fdf-cea4-431c-abd4-006a5dd37f88] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:12:55.823454 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-47101b5c-9597-4422-a9b9-7f885b21be77 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:12:55.823907 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-47101b5c-9597-4422-a9b9-7f885b21be77 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:12:55.826538 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-47101b5c-9597-4422-a9b9-7f885b21be77 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:12:55.826979 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-47101b5c-9597-4422-a9b9-7f885b21be77 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:12:55.922868 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-47101b5c-9597-4422-a9b9-7f885b21be77 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac71714265342098d2487a701a6c364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f76a684261dd49f68a42a4e157355f37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:12:55.930373 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-47101b5c-9597-4422-a9b9-7f885b21be77 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] 10.222.0.20 "GET /compute/v2.1/servers/8e620fdf-cea4-431c-abd4-006a5dd37f88" status: 200 len: 1614 microversion: 2.1 time: 0.118320 Jul 01 04:12:55.930942 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 387/782] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:12:55 2022] GET /compute/v2.1/servers/8e620fdf-cea4-431c-abd4-006a5dd37f88 => generated 1614 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 04:12:56.013851 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [req-a9c00b65-e1b2-406d-85c6-cfdf4312c48d req-b4787a09-061d-4947-b56f-f464270e0ba7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e620fdf-cea4-431c-abd4-006a5dd37f88", "name": "network-vif-deleted", "tag": "ce5fe4b2-9dff-4c4f-8741-8db0d584da49"}]} {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 04:12:56.023361 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [req-a9c00b65-e1b2-406d-85c6-cfdf4312c48d req-b4787a09-061d-4947-b56f-f464270e0ba7 service nova] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:12:56.023804 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [req-a9c00b65-e1b2-406d-85c6-cfdf4312c48d req-b4787a09-061d-4947-b56f-f464270e0ba7 service nova] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:12:56.037882 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.compute.server_external_events [req-a9c00b65-e1b2-406d-85c6-cfdf4312c48d req-b4787a09-061d-4947-b56f-f464270e0ba7 service nova] Creating event network-vif-deleted:ce5fe4b2-9dff-4c4f-8741-8db0d584da49 for instance 8e620fdf-cea4-431c-abd4-006a5dd37f88 on hv-cinder-84684 Jul 01 04:12:56.043680 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [req-a9c00b65-e1b2-406d-85c6-cfdf4312c48d req-b4787a09-061d-4947-b56f-f464270e0ba7 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033101 Jul 01 04:12:56.044337 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 396/783] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Jul 1 04:12:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 04:12:56.947943 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-7603c1bc-e145-48ee-8c57-2326c4c42d0e tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:12:56.948591 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-7603c1bc-e145-48ee-8c57-2326c4c42d0e tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] [instance: 8e620fdf-cea4-431c-abd4-006a5dd37f88] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:12:56.955763 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-7603c1bc-e145-48ee-8c57-2326c4c42d0e tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:12:56.956215 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-7603c1bc-e145-48ee-8c57-2326c4c42d0e tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:12:56.957049 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-7603c1bc-e145-48ee-8c57-2326c4c42d0e tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:12:56.957490 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-7603c1bc-e145-48ee-8c57-2326c4c42d0e tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:12:56.996280 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-7603c1bc-e145-48ee-8c57-2326c4c42d0e tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:12:56.996890 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-7603c1bc-e145-48ee-8c57-2326c4c42d0e tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:12:56.997180 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.objects.instance [None req-7603c1bc-e145-48ee-8c57-2326c4c42d0e tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lazy-loading 'fault' on Instance uuid 8e620fdf-cea4-431c-abd4-006a5dd37f88 {{(pid=118711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 04:12:57.039843 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-7603c1bc-e145-48ee-8c57-2326c4c42d0e tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac71714265342098d2487a701a6c364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f76a684261dd49f68a42a4e157355f37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:12:57.047685 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-7603c1bc-e145-48ee-8c57-2326c4c42d0e tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] 10.222.0.20 "GET /compute/v2.1/servers/8e620fdf-cea4-431c-abd4-006a5dd37f88" status: 200 len: 1330 microversion: 2.1 time: 0.103718 Jul 01 04:12:57.048278 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 388/784] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:12:56 2022] GET /compute/v2.1/servers/8e620fdf-cea4-431c-abd4-006a5dd37f88 => generated 1330 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:12:58.066369 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-6422a59e-6ef0-4bdd-930a-f773d7105fa0 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:12:58.067960 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-6422a59e-6ef0-4bdd-930a-f773d7105fa0 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] [instance: 8e620fdf-cea4-431c-abd4-006a5dd37f88] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:12:58.075039 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-6422a59e-6ef0-4bdd-930a-f773d7105fa0 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:12:58.075534 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-6422a59e-6ef0-4bdd-930a-f773d7105fa0 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:12:58.076328 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-6422a59e-6ef0-4bdd-930a-f773d7105fa0 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:12:58.076806 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-6422a59e-6ef0-4bdd-930a-f773d7105fa0 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:12:58.091794 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.wsgi [None req-6422a59e-6ef0-4bdd-930a-f773d7105fa0 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] HTTP exception thrown: Instance 8e620fdf-cea4-431c-abd4-006a5dd37f88 could not be found. Jul 01 04:12:58.093453 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-6422a59e-6ef0-4bdd-930a-f773d7105fa0 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Request method failure captured: Jul 01 04:12:58.093453 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: request: GET /compute/v2.1/servers/8e620fdf-cea4-431c-abd4-006a5dd37f88 HTTP/1.1 Jul 01 04:12:58.093453 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: Accept: application/json Jul 01 04:12:58.093453 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: Accept-Encoding: identity Jul 01 04:12:58.093453 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: Connection: close Jul 01 04:12:58.093453 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: Content-Length: 0 Jul 01 04:12:58.093453 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: Content-Type: application/json Jul 01 04:12:58.093453 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: Host: 10.222.0.20 Jul 01 04:12:58.093453 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: Openstack-System-Scope: None Jul 01 04:12:58.093453 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: User-Agent: python-urllib3/1.26.9 Jul 01 04:12:58.093453 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Auth-Token: gAAAAABivnO_2SHspn5040vH8P4vp6P_nHqsfbY2b8BaTxMU37E-Nm1nW3UiPrXBDY7TPTOcTyJxuvdXyhrWNFcAJgF991L1LL3g9HBHqdiHQSEKxKFPESilMhAE3M7664WhTBceQb5njdTfXXYCgJ_rjpGbTLpsJzn6ZaZQDIGWFCb9NOvUG5w Jul 01 04:12:58.093453 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Domain-Id: None Jul 01 04:12:58.093453 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Domain-Name: None Jul 01 04:12:58.093453 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Identity-Status: Confirmed Jul 01 04:12:58.093453 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Is-Admin-Project: True Jul 01 04:12:58.093453 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Project-Domain-Id: default Jul 01 04:12:58.093453 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Project-Domain-Name: Default Jul 01 04:12:58.093453 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Project-Id: f76a684261dd49f68a42a4e157355f37 Jul 01 04:12:58.093453 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Project-Name: tempest-AttachVolumeNegativeTest-1321993683 Jul 01 04:12:58.093453 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Role: reader,member Jul 01 04:12:58.093453 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Roles: reader,member Jul 01 04:12:58.094838 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/f76a684261dd49f68a42a4e157355f37"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_f76a684261dd49f68a42a4e157355f37", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f76a684261dd49f68a42a4e157355f37"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f76a684261dd49f68a42a4e157355f37"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}] Jul 01 04:12:58.094838 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Tenant: tempest-AttachVolumeNegativeTest-1321993683 Jul 01 04:12:58.094838 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Tenant-Id: f76a684261dd49f68a42a4e157355f37 Jul 01 04:12:58.094838 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1321993683 Jul 01 04:12:58.094838 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-User: tempest-AttachVolumeNegativeTest-1321993683-project Jul 01 04:12:58.094838 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-User-Domain-Id: default Jul 01 04:12:58.094838 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-User-Domain-Name: Default Jul 01 04:12:58.094838 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-User-Id: 4ac71714265342098d2487a701a6c364 Jul 01 04:12:58.094838 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-User-Name: tempest-AttachVolumeNegativeTest-1321993683-project Jul 01 04:12:58.094838 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: method: > Jul 01 04:12:58.094838 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: exception: Instance 8e620fdf-cea4-431c-abd4-006a5dd37f88 could not be found. Jul 01 04:12:58.094838 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: action_args: {'id': '8e620fdf-cea4-431c-abd4-006a5dd37f88'} Jul 01 04:12:58.095607 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 04:12:58.095607 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 04:12:58.095607 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 04:12:58.095607 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 04:12:58.095607 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 04:12:58.095607 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 04:12:58.095607 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 04:12:58.095607 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 04:12:58.095607 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 04:12:58.095607 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 04:12:58.095607 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8e620fdf-cea4-431c-abd4-006a5dd37f88 could not be found. Jul 01 04:12:58.095607 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi Jul 01 04:12:58.095607 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 04:12:58.095607 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi Jul 01 04:12:58.095607 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 04:12:58.095607 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 04:12:58.095607 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 04:12:58.095607 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 04:12:58.095607 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 04:12:58.095607 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 04:12:58.097033 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 04:12:58.097033 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 04:12:58.097033 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 04:12:58.097033 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 04:12:58.097033 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 04:12:58.097033 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 04:12:58.097033 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 04:12:58.097033 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8e620fdf-cea4-431c-abd4-006a5dd37f88 could not be found. Jul 01 04:12:58.097033 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi Jul 01 04:12:58.097033 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 04:12:58.097033 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi Jul 01 04:12:58.097033 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 04:12:58.097033 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 04:12:58.097033 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 04:12:58.097033 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 04:12:58.097033 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 04:12:58.097033 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8e620fdf-cea4-431c-abd4-006a5dd37f88 could not be found. Jul 01 04:12:58.097033 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi Jul 01 04:12:58.098328 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-6422a59e-6ef0-4bdd-930a-f773d7105fa0 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Returning 404 to user: Instance 8e620fdf-cea4-431c-abd4-006a5dd37f88 could not be found. {{(pid=118712) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 04:12:58.098328 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-6422a59e-6ef0-4bdd-930a-f773d7105fa0 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] 10.222.0.20 "GET /compute/v2.1/servers/8e620fdf-cea4-431c-abd4-006a5dd37f88" status: 404 len: 111 microversion: 2.1 time: 0.033257 Jul 01 04:12:58.098328 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 397/785] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:12:58 2022] GET /compute/v2.1/servers/8e620fdf-cea4-431c-abd4-006a5dd37f88 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 04:12:58.103958 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-921cc2fd-00da-464a-8ee4-3964e678050a tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Calling method '.version_select at 0x7f99a0752280>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:12:58.198629 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-921cc2fd-00da-464a-8ee4-3964e678050a tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-777883161" status: 202 len: 0 microversion: 2.1 time: 0.098404 Jul 01 04:12:58.199717 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 389/786] 10.222.0.20 () {58 vars in 1217 bytes} [Fri Jul 1 04:12:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-777883161 => generated 0 bytes in 100 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 04:12:59.283929 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-f199a44e-04a3-4b6d-b294-4ad21ea7ca53 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Action: 'create', calling method: .version_select at 0x7f99a068caf0>, body: {"keypair": {"name": "tempest-keypair-1221054957", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBsaPez97X0OK7sJs4t241d5V5VWb1N7A/7t5GzzIG8og/Iyz8cXk6U/r5ZcYfyaO5VqpYqAOxFwfDUgFM0D6rkgsCK+LDWizIGWT6FFLLAG+50lCCALMA8FqnGEnnixkA=="}} {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 04:12:59.298472 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.quota [None req-f199a44e-04a3-4b6d-b294-4ad21ea7ca53 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Getting quotas for project f76a684261dd49f68a42a4e157355f37. Resources: {'key_pairs'} {{(pid=118712) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 04:12:59.302508 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.quota [None req-f199a44e-04a3-4b6d-b294-4ad21ea7ca53 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Getting quotas for user 4ac71714265342098d2487a701a6c364 and project f76a684261dd49f68a42a4e157355f37. Resources: {'key_pairs'} {{(pid=118712) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 04:12:59.403187 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-f199a44e-04a3-4b6d-b294-4ad21ea7ca53 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.123032 Jul 01 04:12:59.403937 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 398/787] 10.222.0.20 () {60 vars in 1158 bytes} [Fri Jul 1 04:12:59 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 04:13:01.872118 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-6fbf4c94-a6f3-44bf-9d4d-9a58501b6f82 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-275356728", "imageRef": "66f9f4ba-339c-4967-8857-d65299a66629", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "72a30e53-10ad-40de-bc68-366d09fc48e5"}], "security_groups": [{"name": "tempest-securitygroup--1081487705"}], "key_name": "tempest-keypair-1221054957", "user_data": "}} {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 04:13:01.978478 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.network.neutron [None req-6fbf4c94-a6f3-44bf-9d4d-9a58501b6f82 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] validate_networks() for [('72a30e53-10ad-40de-bc68-366d09fc48e5', None, None, None, None, None)] {{(pid=118711) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 01 04:13:02.370842 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.virt.hardware [None req-6fbf4c94-a6f3-44bf-9d4d-9a58501b6f82 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Flavor limits 0:0:0 {{(pid=118711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 01 04:13:02.371307 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.virt.hardware [None req-6fbf4c94-a6f3-44bf-9d4d-9a58501b6f82 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Image limits 0:0:0 {{(pid=118711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 01 04:13:02.371798 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.virt.hardware [None req-6fbf4c94-a6f3-44bf-9d4d-9a58501b6f82 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Flavor pref 0:0:0 {{(pid=118711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 01 04:13:02.372212 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.virt.hardware [None req-6fbf4c94-a6f3-44bf-9d4d-9a58501b6f82 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Image pref 0:0:0 {{(pid=118711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 01 04:13:02.372630 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.virt.hardware [None req-6fbf4c94-a6f3-44bf-9d4d-9a58501b6f82 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 01 04:13:02.382089 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-6fbf4c94-a6f3-44bf-9d4d-9a58501b6f82 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:13:02.382543 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-6fbf4c94-a6f3-44bf-9d4d-9a58501b6f82 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:13:02.383388 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-6fbf4c94-a6f3-44bf-9d4d-9a58501b6f82 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:13:02.383834 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-6fbf4c94-a6f3-44bf-9d4d-9a58501b6f82 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:13:02.401122 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.quota [None req-6fbf4c94-a6f3-44bf-9d4d-9a58501b6f82 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Getting quotas for project f76a684261dd49f68a42a4e157355f37. Resources: {'ram', 'cores', 'instances'} {{(pid=118711) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 04:13:02.405245 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.quota [None req-6fbf4c94-a6f3-44bf-9d4d-9a58501b6f82 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Getting quotas for user 4ac71714265342098d2487a701a6c364 and project f76a684261dd49f68a42a4e157355f37. Resources: {'ram', 'cores', 'instances'} {{(pid=118711) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 04:13:02.416470 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-6fbf4c94-a6f3-44bf-9d4d-9a58501b6f82 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Going to run 1 instances... {{(pid=118711) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 01 04:13:02.418755 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-6fbf4c94-a6f3-44bf-9d4d-9a58501b6f82 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] [instance: 0c303914-e7aa-4775-a6ae-b57f31cfe479] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='66f9f4ba-339c-4967-8857-d65299a66629',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118711) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 01 04:13:02.531165 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-6fbf4c94-a6f3-44bf-9d4d-9a58501b6f82 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.663981 Jul 01 04:13:02.531848 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 390/788] 10.222.0.20 () {60 vars in 1146 bytes} [Fri Jul 1 04:13:01 2022] POST /compute/v2.1/servers => generated 402 bytes in 665 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 01 04:13:02.542790 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-09bcc747-496b-4b4e-a818-c6b6d18fb105 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:13:02.548508 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-09bcc747-496b-4b4e-a818-c6b6d18fb105 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] [instance: 0c303914-e7aa-4775-a6ae-b57f31cfe479] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:13:02.610421 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-09bcc747-496b-4b4e-a818-c6b6d18fb105 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac71714265342098d2487a701a6c364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f76a684261dd49f68a42a4e157355f37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:13:02.622381 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-09bcc747-496b-4b4e-a818-c6b6d18fb105 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] 10.222.0.20 "GET /compute/v2.1/servers/0c303914-e7aa-4775-a6ae-b57f31cfe479" status: 200 len: 1241 microversion: 2.1 time: 0.079779 Jul 01 04:13:02.622381 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 399/789] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:13:02 2022] GET /compute/v2.1/servers/0c303914-e7aa-4775-a6ae-b57f31cfe479 => generated 1241 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:13:03.634994 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-c1f97ed1-96a2-4ae1-a17d-d20dc0258e17 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:13:03.635655 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-c1f97ed1-96a2-4ae1-a17d-d20dc0258e17 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] [instance: 0c303914-e7aa-4775-a6ae-b57f31cfe479] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:13:03.644222 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-c1f97ed1-96a2-4ae1-a17d-d20dc0258e17 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:13:03.644685 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-c1f97ed1-96a2-4ae1-a17d-d20dc0258e17 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:13:03.645520 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-c1f97ed1-96a2-4ae1-a17d-d20dc0258e17 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:13:03.645965 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-c1f97ed1-96a2-4ae1-a17d-d20dc0258e17 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:13:03.713124 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-c1f97ed1-96a2-4ae1-a17d-d20dc0258e17 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac71714265342098d2487a701a6c364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f76a684261dd49f68a42a4e157355f37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:13:03.721594 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-c1f97ed1-96a2-4ae1-a17d-d20dc0258e17 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] 10.222.0.20 "GET /compute/v2.1/servers/0c303914-e7aa-4775-a6ae-b57f31cfe479" status: 200 len: 1245 microversion: 2.1 time: 0.090560 Jul 01 04:13:03.722198 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 391/790] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:13:03 2022] GET /compute/v2.1/servers/0c303914-e7aa-4775-a6ae-b57f31cfe479 => generated 1245 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:13:04.739364 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-3c6c84a0-5ee5-42ba-8196-e2f2bf879c2c tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:13:04.741043 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-3c6c84a0-5ee5-42ba-8196-e2f2bf879c2c tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] [instance: 0c303914-e7aa-4775-a6ae-b57f31cfe479] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:13:04.746527 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-3c6c84a0-5ee5-42ba-8196-e2f2bf879c2c tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:13:04.746976 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-3c6c84a0-5ee5-42ba-8196-e2f2bf879c2c tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:13:04.747918 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-3c6c84a0-5ee5-42ba-8196-e2f2bf879c2c tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:13:04.748357 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-3c6c84a0-5ee5-42ba-8196-e2f2bf879c2c tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:13:04.816144 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-3c6c84a0-5ee5-42ba-8196-e2f2bf879c2c tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac71714265342098d2487a701a6c364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f76a684261dd49f68a42a4e157355f37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:13:04.824057 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-3c6c84a0-5ee5-42ba-8196-e2f2bf879c2c tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] 10.222.0.20 "GET /compute/v2.1/servers/0c303914-e7aa-4775-a6ae-b57f31cfe479" status: 200 len: 1301 microversion: 2.1 time: 0.089089 Jul 01 04:13:04.824588 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 400/791] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:13:04 2022] GET /compute/v2.1/servers/0c303914-e7aa-4775-a6ae-b57f31cfe479 => generated 1301 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:13:05.846214 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-12e2d9fc-84c8-45dc-b359-c307f4382066 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:13:05.846835 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-12e2d9fc-84c8-45dc-b359-c307f4382066 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] [instance: 0c303914-e7aa-4775-a6ae-b57f31cfe479] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:13:05.853770 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-12e2d9fc-84c8-45dc-b359-c307f4382066 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:13:05.854142 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-12e2d9fc-84c8-45dc-b359-c307f4382066 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:13:05.854884 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-12e2d9fc-84c8-45dc-b359-c307f4382066 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:13:05.855453 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-12e2d9fc-84c8-45dc-b359-c307f4382066 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:13:06.038233 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-12e2d9fc-84c8-45dc-b359-c307f4382066 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac71714265342098d2487a701a6c364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f76a684261dd49f68a42a4e157355f37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:13:06.046038 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-12e2d9fc-84c8-45dc-b359-c307f4382066 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] 10.222.0.20 "GET /compute/v2.1/servers/0c303914-e7aa-4775-a6ae-b57f31cfe479" status: 200 len: 1367 microversion: 2.1 time: 0.203787 Jul 01 04:13:06.046626 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 392/792] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:13:05 2022] GET /compute/v2.1/servers/0c303914-e7aa-4775-a6ae-b57f31cfe479 => generated 1367 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:13:06.483917 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [req-4bf043fe-a654-4053-935e-f1566324f839 req-119eaa16-a2f4-4e92-a6be-2426698ebdd7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0c303914-e7aa-4775-a6ae-b57f31cfe479", "tag": "4550d2de-2810-47c5-9f6d-1b915cc006c5"}]} {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 04:13:06.498588 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [req-4bf043fe-a654-4053-935e-f1566324f839 req-119eaa16-a2f4-4e92-a6be-2426698ebdd7 service nova] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:13:06.502004 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [req-4bf043fe-a654-4053-935e-f1566324f839 req-119eaa16-a2f4-4e92-a6be-2426698ebdd7 service nova] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:13:06.516497 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.compute.server_external_events [req-4bf043fe-a654-4053-935e-f1566324f839 req-119eaa16-a2f4-4e92-a6be-2426698ebdd7 service nova] Creating event network-changed:4550d2de-2810-47c5-9f6d-1b915cc006c5 for instance 0c303914-e7aa-4775-a6ae-b57f31cfe479 on hv-cinder-84684 Jul 01 04:13:06.522174 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [req-4bf043fe-a654-4053-935e-f1566324f839 req-119eaa16-a2f4-4e92-a6be-2426698ebdd7 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050122 Jul 01 04:13:06.522791 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 401/793] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Jul 1 04:13:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 04:13:07.064800 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-9309180f-0eb4-41da-bf95-74c943d1684d tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:13:07.067401 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-9309180f-0eb4-41da-bf95-74c943d1684d tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] [instance: 0c303914-e7aa-4775-a6ae-b57f31cfe479] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:13:07.073977 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-9309180f-0eb4-41da-bf95-74c943d1684d tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:13:07.074480 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-9309180f-0eb4-41da-bf95-74c943d1684d tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:13:07.075464 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-9309180f-0eb4-41da-bf95-74c943d1684d tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:13:07.076194 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-9309180f-0eb4-41da-bf95-74c943d1684d tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:13:07.357174 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-9309180f-0eb4-41da-bf95-74c943d1684d tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac71714265342098d2487a701a6c364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f76a684261dd49f68a42a4e157355f37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:13:07.365207 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-9309180f-0eb4-41da-bf95-74c943d1684d tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] 10.222.0.20 "GET /compute/v2.1/servers/0c303914-e7aa-4775-a6ae-b57f31cfe479" status: 200 len: 1367 microversion: 2.1 time: 0.304904 Jul 01 04:13:07.365793 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 393/794] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:13:07 2022] GET /compute/v2.1/servers/0c303914-e7aa-4775-a6ae-b57f31cfe479 => generated 1367 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:13:08.393896 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-9221ada7-7a07-47c3-b6c5-8c41a01ce6f1 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:13:08.394635 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-9221ada7-7a07-47c3-b6c5-8c41a01ce6f1 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] [instance: 0c303914-e7aa-4775-a6ae-b57f31cfe479] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:13:08.400996 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-9221ada7-7a07-47c3-b6c5-8c41a01ce6f1 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:13:08.401452 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-9221ada7-7a07-47c3-b6c5-8c41a01ce6f1 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:13:08.402264 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-9221ada7-7a07-47c3-b6c5-8c41a01ce6f1 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:13:08.402705 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-9221ada7-7a07-47c3-b6c5-8c41a01ce6f1 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:13:08.541420 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-9221ada7-7a07-47c3-b6c5-8c41a01ce6f1 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac71714265342098d2487a701a6c364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f76a684261dd49f68a42a4e157355f37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:13:08.549138 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-9221ada7-7a07-47c3-b6c5-8c41a01ce6f1 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] 10.222.0.20 "GET /compute/v2.1/servers/0c303914-e7aa-4775-a6ae-b57f31cfe479" status: 200 len: 1367 microversion: 2.1 time: 0.160467 Jul 01 04:13:08.549711 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 402/795] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:13:08 2022] GET /compute/v2.1/servers/0c303914-e7aa-4775-a6ae-b57f31cfe479 => generated 1367 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:13:09.567294 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-12c99c07-e5cb-422f-807f-d067b3b018de tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:13:09.567946 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-12c99c07-e5cb-422f-807f-d067b3b018de tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] [instance: 0c303914-e7aa-4775-a6ae-b57f31cfe479] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:13:09.575217 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-12c99c07-e5cb-422f-807f-d067b3b018de tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:13:09.575788 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-12c99c07-e5cb-422f-807f-d067b3b018de tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:13:09.576623 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-12c99c07-e5cb-422f-807f-d067b3b018de tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:13:09.577139 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-12c99c07-e5cb-422f-807f-d067b3b018de tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:13:09.727805 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-12c99c07-e5cb-422f-807f-d067b3b018de tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac71714265342098d2487a701a6c364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f76a684261dd49f68a42a4e157355f37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:13:09.736535 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-12c99c07-e5cb-422f-807f-d067b3b018de tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] 10.222.0.20 "GET /compute/v2.1/servers/0c303914-e7aa-4775-a6ae-b57f31cfe479" status: 200 len: 1367 microversion: 2.1 time: 0.173812 Jul 01 04:13:09.737327 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 394/796] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:13:09 2022] GET /compute/v2.1/servers/0c303914-e7aa-4775-a6ae-b57f31cfe479 => generated 1367 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:13:10.754017 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-b311eced-5df8-4367-bfb7-9078ac23fce1 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:13:10.754637 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-b311eced-5df8-4367-bfb7-9078ac23fce1 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] [instance: 0c303914-e7aa-4775-a6ae-b57f31cfe479] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:13:10.761741 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-b311eced-5df8-4367-bfb7-9078ac23fce1 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:13:10.762204 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-b311eced-5df8-4367-bfb7-9078ac23fce1 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:13:10.762985 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-b311eced-5df8-4367-bfb7-9078ac23fce1 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:13:10.763462 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-b311eced-5df8-4367-bfb7-9078ac23fce1 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:13:10.907779 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-b311eced-5df8-4367-bfb7-9078ac23fce1 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac71714265342098d2487a701a6c364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f76a684261dd49f68a42a4e157355f37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:13:10.916653 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-b311eced-5df8-4367-bfb7-9078ac23fce1 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] 10.222.0.20 "GET /compute/v2.1/servers/0c303914-e7aa-4775-a6ae-b57f31cfe479" status: 200 len: 1367 microversion: 2.1 time: 0.166530 Jul 01 04:13:10.917267 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 403/797] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:13:10 2022] GET /compute/v2.1/servers/0c303914-e7aa-4775-a6ae-b57f31cfe479 => generated 1367 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 04:13:11.792758 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-a1534397-13e9-4ce4-8760-1441da8587c9 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:13:11.793333 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-a1534397-13e9-4ce4-8760-1441da8587c9 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] [instance: 2e5d1edc-dbae-41dd-ab34-aa954b62f390] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:13:11.804979 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-a1534397-13e9-4ce4-8760-1441da8587c9 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:13:11.805744 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-a1534397-13e9-4ce4-8760-1441da8587c9 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:13:11.806985 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-a1534397-13e9-4ce4-8760-1441da8587c9 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:13:11.807861 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-a1534397-13e9-4ce4-8760-1441da8587c9 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:13:11.832170 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-a1534397-13e9-4ce4-8760-1441da8587c9 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] 10.222.0.20 "GET /compute/v2.1/servers/2e5d1edc-dbae-41dd-ab34-aa954b62f390/ips" status: 200 len: 145 microversion: 2.1 time: 0.043290 Jul 01 04:13:11.832753 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 395/798] 10.222.0.20 () {58 vars in 1247 bytes} [Fri Jul 1 04:13:11 2022] GET /compute/v2.1/servers/2e5d1edc-dbae-41dd-ab34-aa954b62f390/ips => generated 145 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 04:13:11.933918 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-66610ee2-9a40-44d4-96a1-c81a1099cdd7 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:13:11.934544 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-66610ee2-9a40-44d4-96a1-c81a1099cdd7 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] [instance: 0c303914-e7aa-4775-a6ae-b57f31cfe479] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:13:11.941260 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-66610ee2-9a40-44d4-96a1-c81a1099cdd7 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:13:11.941717 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-66610ee2-9a40-44d4-96a1-c81a1099cdd7 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:13:11.942744 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-66610ee2-9a40-44d4-96a1-c81a1099cdd7 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:13:11.943187 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-66610ee2-9a40-44d4-96a1-c81a1099cdd7 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:13:12.070874 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [req-c24f5d93-0c8b-41ac-8e81-83e7a7a0ab81 req-5b1b6798-dfa9-4b4f-8a95-f0f0a1624063 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c303914-e7aa-4775-a6ae-b57f31cfe479", "name": "network-vif-plugged", "status": "completed", "tag": "4550d2de-2810-47c5-9f6d-1b915cc006c5"}]} {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 04:13:12.079806 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [req-c24f5d93-0c8b-41ac-8e81-83e7a7a0ab81 req-5b1b6798-dfa9-4b4f-8a95-f0f0a1624063 service nova] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:13:12.080257 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [req-c24f5d93-0c8b-41ac-8e81-83e7a7a0ab81 req-5b1b6798-dfa9-4b4f-8a95-f0f0a1624063 service nova] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:13:12.090259 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-66610ee2-9a40-44d4-96a1-c81a1099cdd7 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac71714265342098d2487a701a6c364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f76a684261dd49f68a42a4e157355f37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:13:12.098619 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-66610ee2-9a40-44d4-96a1-c81a1099cdd7 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] 10.222.0.20 "GET /compute/v2.1/servers/0c303914-e7aa-4775-a6ae-b57f31cfe479" status: 200 len: 1367 microversion: 2.1 time: 0.168606 Jul 01 04:13:12.099196 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 404/799] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:13:11 2022] GET /compute/v2.1/servers/0c303914-e7aa-4775-a6ae-b57f31cfe479 => generated 1367 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:13:12.103629 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.compute.server_external_events [req-c24f5d93-0c8b-41ac-8e81-83e7a7a0ab81 req-5b1b6798-dfa9-4b4f-8a95-f0f0a1624063 service nova] Creating event network-vif-plugged:4550d2de-2810-47c5-9f6d-1b915cc006c5 for instance 0c303914-e7aa-4775-a6ae-b57f31cfe479 on hv-cinder-84684 Jul 01 04:13:12.110229 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [req-c24f5d93-0c8b-41ac-8e81-83e7a7a0ab81 req-5b1b6798-dfa9-4b4f-8a95-f0f0a1624063 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043297 Jul 01 04:13:12.110875 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 396/800] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Jul 1 04:13:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 01 04:13:13.116177 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-d70d0f10-5e6f-4009-abb6-51ec4060935f tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:13:13.116858 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-d70d0f10-5e6f-4009-abb6-51ec4060935f tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] [instance: 0c303914-e7aa-4775-a6ae-b57f31cfe479] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:13:13.118836 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG dbcounter [-] [118712] Writing DB stats nova_cell0:SELECT=6 {{(pid=118712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:13:13.124241 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-d70d0f10-5e6f-4009-abb6-51ec4060935f tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:13:13.124665 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-d70d0f10-5e6f-4009-abb6-51ec4060935f tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:13:13.125440 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-d70d0f10-5e6f-4009-abb6-51ec4060935f tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:13:13.125888 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-d70d0f10-5e6f-4009-abb6-51ec4060935f tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:13:13.263902 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-d70d0f10-5e6f-4009-abb6-51ec4060935f tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac71714265342098d2487a701a6c364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f76a684261dd49f68a42a4e157355f37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:13:13.271922 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-d70d0f10-5e6f-4009-abb6-51ec4060935f tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] 10.222.0.20 "GET /compute/v2.1/servers/0c303914-e7aa-4775-a6ae-b57f31cfe479" status: 200 len: 1367 microversion: 2.1 time: 0.159522 Jul 01 04:13:13.272513 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 405/801] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:13:13 2022] GET /compute/v2.1/servers/0c303914-e7aa-4775-a6ae-b57f31cfe479 => generated 1367 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:13:14.286723 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG dbcounter [-] [118711] Writing DB stats nova_cell0:SELECT=2 {{(pid=118711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:13:14.287660 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG dbcounter [-] [118711] Writing DB stats nova_cell0:SELECT=6 {{(pid=118711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:13:14.292412 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-d4a1d1c1-90d6-40a4-bd39-26623e747f5b tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:13:14.293126 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-d4a1d1c1-90d6-40a4-bd39-26623e747f5b tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] [instance: 0c303914-e7aa-4775-a6ae-b57f31cfe479] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:13:14.300293 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-d4a1d1c1-90d6-40a4-bd39-26623e747f5b tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:13:14.302780 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-d4a1d1c1-90d6-40a4-bd39-26623e747f5b tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:13:14.302780 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-d4a1d1c1-90d6-40a4-bd39-26623e747f5b tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:13:14.302780 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-d4a1d1c1-90d6-40a4-bd39-26623e747f5b tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:13:14.306222 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG dbcounter [-] [118711] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=118711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:13:14.457262 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-d4a1d1c1-90d6-40a4-bd39-26623e747f5b tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac71714265342098d2487a701a6c364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f76a684261dd49f68a42a4e157355f37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:13:14.460987 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-b6f9556b-402f-4414-a305-919c88241c2e tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6d88b683-ef7f-4bd8-a8d6-51f98efb2056"}} {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 04:13:14.462152 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-b6f9556b-402f-4414-a305-919c88241c2e tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] [instance: 2e5d1edc-dbae-41dd-ab34-aa954b62f390] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:13:14.464952 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-d4a1d1c1-90d6-40a4-bd39-26623e747f5b tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] 10.222.0.20 "GET /compute/v2.1/servers/0c303914-e7aa-4775-a6ae-b57f31cfe479" status: 200 len: 1557 microversion: 2.1 time: 0.179296 Jul 01 04:13:14.465512 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 397/802] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:13:14 2022] GET /compute/v2.1/servers/0c303914-e7aa-4775-a6ae-b57f31cfe479 => generated 1557 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:13:14.468577 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-b6f9556b-402f-4414-a305-919c88241c2e tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:13:14.469027 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-b6f9556b-402f-4414-a305-919c88241c2e tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:13:14.469826 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-b6f9556b-402f-4414-a305-919c88241c2e tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:13:14.470260 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-b6f9556b-402f-4414-a305-919c88241c2e tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:13:14.481489 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-14cef21d-9ca7-4098-a094-c16bc8b055cd tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:13:14.481981 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-14cef21d-9ca7-4098-a094-c16bc8b055cd tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] [instance: 0c303914-e7aa-4775-a6ae-b57f31cfe479] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:13:14.489267 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-14cef21d-9ca7-4098-a094-c16bc8b055cd tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:13:14.489647 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-14cef21d-9ca7-4098-a094-c16bc8b055cd tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:13:14.490419 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-14cef21d-9ca7-4098-a094-c16bc8b055cd tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:13:14.490856 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-14cef21d-9ca7-4098-a094-c16bc8b055cd tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:13:14.575166 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-14cef21d-9ca7-4098-a094-c16bc8b055cd tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] 10.222.0.20 "GET /compute/v2.1/servers/0c303914-e7aa-4775-a6ae-b57f31cfe479/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.097389 Jul 01 04:13:14.576037 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 398/803] 10.222.0.20 () {58 vars in 1274 bytes} [Fri Jul 1 04:13:14 2022] GET /compute/v2.1/servers/0c303914-e7aa-4775-a6ae-b57f31cfe479/os-interface => generated 284 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 01 04:13:15.280142 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-b6f9556b-402f-4414-a305-919c88241c2e tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] 10.222.0.20 "POST /compute/v2.1/servers/2e5d1edc-dbae-41dd-ab34-aa954b62f390/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.822734 Jul 01 04:13:15.280926 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 406/804] 10.222.0.20 () {60 vars in 1322 bytes} [Fri Jul 1 04:13:14 2022] POST /compute/v2.1/servers/2e5d1edc-dbae-41dd-ab34-aa954b62f390/os-volume_attachments => generated 194 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 01 04:13:15.744336 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [req-41baff1f-bcf8-45c3-bc87-8972cbee4711 req-0df7e6b2-6018-43bd-8b69-e8f1344f0c66 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0c303914-e7aa-4775-a6ae-b57f31cfe479", "tag": "4550d2de-2810-47c5-9f6d-1b915cc006c5"}]} {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 04:13:15.749809 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG dbcounter [-] [118711] Writing DB stats nova_api:SELECT=62,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=118711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:13:15.757937 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [req-41baff1f-bcf8-45c3-bc87-8972cbee4711 req-0df7e6b2-6018-43bd-8b69-e8f1344f0c66 service nova] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:13:15.758379 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [req-41baff1f-bcf8-45c3-bc87-8972cbee4711 req-0df7e6b2-6018-43bd-8b69-e8f1344f0c66 service nova] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:13:15.771052 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.compute.server_external_events [req-41baff1f-bcf8-45c3-bc87-8972cbee4711 req-0df7e6b2-6018-43bd-8b69-e8f1344f0c66 service nova] Creating event network-changed:4550d2de-2810-47c5-9f6d-1b915cc006c5 for instance 0c303914-e7aa-4775-a6ae-b57f31cfe479 on hv-cinder-84684 Jul 01 04:13:15.776421 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [req-41baff1f-bcf8-45c3-bc87-8972cbee4711 req-0df7e6b2-6018-43bd-8b69-e8f1344f0c66 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037675 Jul 01 04:13:15.777027 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 399/805] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Jul 1 04:13:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 04:13:22.860071 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-737ccb2c-8cb8-41a7-9636-b7d5102aabf4 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 04:13:22.880206 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-737ccb2c-8cb8-41a7-9636-b7d5102aabf4 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:13:22.880206 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-737ccb2c-8cb8-41a7-9636-b7d5102aabf4 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:13:22.935527 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-737ccb2c-8cb8-41a7-9636-b7d5102aabf4 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] [instance: 2e5d1edc-dbae-41dd-ab34-aa954b62f390] Going to try to stop instance {{(pid=118712) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 01 04:13:23.148239 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-737ccb2c-8cb8-41a7-9636-b7d5102aabf4 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] 10.222.0.20 "POST /compute/v2.1/servers/2e5d1edc-dbae-41dd-ab34-aa954b62f390/action" status: 202 len: 0 microversion: 2.1 time: 0.292819 Jul 01 04:13:23.149063 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 407/806] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Jul 1 04:13:22 2022] POST /compute/v2.1/servers/2e5d1edc-dbae-41dd-ab34-aa954b62f390/action => generated 0 bytes in 295 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 01 04:13:23.159537 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-1458e1d1-a369-4c0c-8d6d-e5d95862a03f tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:13:23.160257 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-1458e1d1-a369-4c0c-8d6d-e5d95862a03f tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] [instance: 2e5d1edc-dbae-41dd-ab34-aa954b62f390] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:13:23.167505 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-1458e1d1-a369-4c0c-8d6d-e5d95862a03f tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:13:23.167811 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-1458e1d1-a369-4c0c-8d6d-e5d95862a03f tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:13:23.168594 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-1458e1d1-a369-4c0c-8d6d-e5d95862a03f tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:13:23.169036 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-1458e1d1-a369-4c0c-8d6d-e5d95862a03f tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:13:23.334390 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-1458e1d1-a369-4c0c-8d6d-e5d95862a03f tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73d76a988462431fa6bb03dca64463a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9614129d1e864c3ea288aaac8387c5d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:13:23.347766 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-1458e1d1-a369-4c0c-8d6d-e5d95862a03f tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] 10.222.0.20 "GET /compute/v2.1/servers/2e5d1edc-dbae-41dd-ab34-aa954b62f390" status: 200 len: 1722 microversion: 2.1 time: 0.193312 Jul 01 04:13:23.348949 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 400/807] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:13:23 2022] GET /compute/v2.1/servers/2e5d1edc-dbae-41dd-ab34-aa954b62f390 => generated 1722 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:13:24.369089 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-67038536-9348-43a8-a812-ea108f914eab tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:13:24.369803 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-67038536-9348-43a8-a812-ea108f914eab tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] [instance: 2e5d1edc-dbae-41dd-ab34-aa954b62f390] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:13:24.371860 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG dbcounter [-] [118712] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=118712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:13:24.377580 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-67038536-9348-43a8-a812-ea108f914eab tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:13:24.378039 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-67038536-9348-43a8-a812-ea108f914eab tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:13:24.378876 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-67038536-9348-43a8-a812-ea108f914eab tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:13:24.379355 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-67038536-9348-43a8-a812-ea108f914eab tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:13:24.383683 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG dbcounter [-] [118712] Writing DB stats nova_cell1:SELECT=83,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=118712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:13:24.528723 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-67038536-9348-43a8-a812-ea108f914eab tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73d76a988462431fa6bb03dca64463a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9614129d1e864c3ea288aaac8387c5d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:13:24.542017 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-67038536-9348-43a8-a812-ea108f914eab tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] 10.222.0.20 "GET /compute/v2.1/servers/2e5d1edc-dbae-41dd-ab34-aa954b62f390" status: 200 len: 1722 microversion: 2.1 time: 0.177563 Jul 01 04:13:24.543102 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 408/808] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:13:24 2022] GET /compute/v2.1/servers/2e5d1edc-dbae-41dd-ab34-aa954b62f390 => generated 1722 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 04:13:25.562653 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-d1209396-b608-4b94-b477-c6e6ce6e28c9 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:13:25.567581 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-d1209396-b608-4b94-b477-c6e6ce6e28c9 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] [instance: 2e5d1edc-dbae-41dd-ab34-aa954b62f390] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:13:25.570453 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-d1209396-b608-4b94-b477-c6e6ce6e28c9 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:13:25.570908 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-d1209396-b608-4b94-b477-c6e6ce6e28c9 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:13:25.571783 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-d1209396-b608-4b94-b477-c6e6ce6e28c9 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:13:25.572230 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-d1209396-b608-4b94-b477-c6e6ce6e28c9 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:13:25.710562 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-d1209396-b608-4b94-b477-c6e6ce6e28c9 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73d76a988462431fa6bb03dca64463a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9614129d1e864c3ea288aaac8387c5d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:13:25.718593 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-d1209396-b608-4b94-b477-c6e6ce6e28c9 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] 10.222.0.20 "GET /compute/v2.1/servers/2e5d1edc-dbae-41dd-ab34-aa954b62f390" status: 200 len: 1722 microversion: 2.1 time: 0.160156 Jul 01 04:13:25.719152 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 401/809] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:13:25 2022] GET /compute/v2.1/servers/2e5d1edc-dbae-41dd-ab34-aa954b62f390 => generated 1722 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 04:13:26.737561 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-00100cce-ff48-4188-95d3-3546c569223f tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:13:26.738260 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-00100cce-ff48-4188-95d3-3546c569223f tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] [instance: 2e5d1edc-dbae-41dd-ab34-aa954b62f390] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:13:26.744809 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-00100cce-ff48-4188-95d3-3546c569223f tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:13:26.745271 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-00100cce-ff48-4188-95d3-3546c569223f tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:13:26.746256 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-00100cce-ff48-4188-95d3-3546c569223f tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:13:26.746978 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-00100cce-ff48-4188-95d3-3546c569223f tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:13:26.888986 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-00100cce-ff48-4188-95d3-3546c569223f tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73d76a988462431fa6bb03dca64463a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9614129d1e864c3ea288aaac8387c5d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:13:26.898062 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-00100cce-ff48-4188-95d3-3546c569223f tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] 10.222.0.20 "GET /compute/v2.1/servers/2e5d1edc-dbae-41dd-ab34-aa954b62f390" status: 200 len: 1722 microversion: 2.1 time: 0.164702 Jul 01 04:13:26.898964 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 409/810] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:13:26 2022] GET /compute/v2.1/servers/2e5d1edc-dbae-41dd-ab34-aa954b62f390 => generated 1722 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:13:27.917689 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-f1a1d150-b183-41c0-bf54-99efde70b27c tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:13:27.918955 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-f1a1d150-b183-41c0-bf54-99efde70b27c tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] [instance: 2e5d1edc-dbae-41dd-ab34-aa954b62f390] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:13:27.925644 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-f1a1d150-b183-41c0-bf54-99efde70b27c tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:13:27.926093 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-f1a1d150-b183-41c0-bf54-99efde70b27c tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:13:27.926857 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-f1a1d150-b183-41c0-bf54-99efde70b27c tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:13:27.927317 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-f1a1d150-b183-41c0-bf54-99efde70b27c tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:13:28.091774 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-f1a1d150-b183-41c0-bf54-99efde70b27c tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73d76a988462431fa6bb03dca64463a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9614129d1e864c3ea288aaac8387c5d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:13:28.099931 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-f1a1d150-b183-41c0-bf54-99efde70b27c tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] 10.222.0.20 "GET /compute/v2.1/servers/2e5d1edc-dbae-41dd-ab34-aa954b62f390" status: 200 len: 1722 microversion: 2.1 time: 0.187510 Jul 01 04:13:28.100502 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 402/811] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:13:27 2022] GET /compute/v2.1/servers/2e5d1edc-dbae-41dd-ab34-aa954b62f390 => generated 1722 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:13:29.117355 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-f8514051-ddfe-48d8-9170-7b2545e3be93 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:13:29.118139 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-f8514051-ddfe-48d8-9170-7b2545e3be93 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] [instance: 2e5d1edc-dbae-41dd-ab34-aa954b62f390] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:13:29.124914 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-f8514051-ddfe-48d8-9170-7b2545e3be93 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:13:29.125381 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-f8514051-ddfe-48d8-9170-7b2545e3be93 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:13:29.126665 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-f8514051-ddfe-48d8-9170-7b2545e3be93 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:13:29.127110 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-f8514051-ddfe-48d8-9170-7b2545e3be93 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:13:29.279799 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-f8514051-ddfe-48d8-9170-7b2545e3be93 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73d76a988462431fa6bb03dca64463a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9614129d1e864c3ea288aaac8387c5d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:13:29.288090 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-f8514051-ddfe-48d8-9170-7b2545e3be93 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] 10.222.0.20 "GET /compute/v2.1/servers/2e5d1edc-dbae-41dd-ab34-aa954b62f390" status: 200 len: 1722 microversion: 2.1 time: 0.174533 Jul 01 04:13:29.288675 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 410/812] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:13:29 2022] GET /compute/v2.1/servers/2e5d1edc-dbae-41dd-ab34-aa954b62f390 => generated 1722 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:13:30.304365 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-dfdaba2c-22e6-484b-9cdd-0f28705c8ae2 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:13:30.305089 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-dfdaba2c-22e6-484b-9cdd-0f28705c8ae2 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] [instance: 2e5d1edc-dbae-41dd-ab34-aa954b62f390] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:13:30.311687 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-dfdaba2c-22e6-484b-9cdd-0f28705c8ae2 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:13:30.311940 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-dfdaba2c-22e6-484b-9cdd-0f28705c8ae2 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:13:30.312701 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-dfdaba2c-22e6-484b-9cdd-0f28705c8ae2 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:13:30.313135 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-dfdaba2c-22e6-484b-9cdd-0f28705c8ae2 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:13:30.455248 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-dfdaba2c-22e6-484b-9cdd-0f28705c8ae2 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73d76a988462431fa6bb03dca64463a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9614129d1e864c3ea288aaac8387c5d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:13:30.461579 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-dfdaba2c-22e6-484b-9cdd-0f28705c8ae2 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] 10.222.0.20 "GET /compute/v2.1/servers/2e5d1edc-dbae-41dd-ab34-aa954b62f390" status: 200 len: 1722 microversion: 2.1 time: 0.161033 Jul 01 04:13:30.462165 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 403/813] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:13:30 2022] GET /compute/v2.1/servers/2e5d1edc-dbae-41dd-ab34-aa954b62f390 => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:13:31.475957 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-34a1615a-60ed-4d2d-830c-214e53889f72 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-695694359", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1409661036", "security_groups": [{"name": "tempest-secgroup-smoke-708261767"}], "block_device_mapping_v2": [{"uuid": "37639f3f-fc49-4fa3-b2ee-84f6a2898b17", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "cc357e98-d192-47c0-8330-c661a213b80c"}]}} {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 04:13:31.477419 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-cfa2aa5f-a011-4e7a-b86f-806a74641208 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:13:31.478020 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-cfa2aa5f-a011-4e7a-b86f-806a74641208 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] [instance: 2e5d1edc-dbae-41dd-ab34-aa954b62f390] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:13:31.484324 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-cfa2aa5f-a011-4e7a-b86f-806a74641208 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:13:31.484772 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-cfa2aa5f-a011-4e7a-b86f-806a74641208 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:13:31.485564 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-cfa2aa5f-a011-4e7a-b86f-806a74641208 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:13:31.485998 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-cfa2aa5f-a011-4e7a-b86f-806a74641208 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:13:31.602211 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.network.neutron [None req-34a1615a-60ed-4d2d-830c-214e53889f72 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] validate_networks() for [('cc357e98-d192-47c0-8330-c661a213b80c', None, None, None, None, None)] {{(pid=118712) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 01 04:13:31.619922 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-cfa2aa5f-a011-4e7a-b86f-806a74641208 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73d76a988462431fa6bb03dca64463a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9614129d1e864c3ea288aaac8387c5d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:13:31.628217 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-cfa2aa5f-a011-4e7a-b86f-806a74641208 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] 10.222.0.20 "GET /compute/v2.1/servers/2e5d1edc-dbae-41dd-ab34-aa954b62f390" status: 200 len: 1722 microversion: 2.1 time: 0.154473 Jul 01 04:13:31.628876 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 404/814] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:13:31 2022] GET /compute/v2.1/servers/2e5d1edc-dbae-41dd-ab34-aa954b62f390 => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 04:13:31.983785 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.virt.hardware [None req-34a1615a-60ed-4d2d-830c-214e53889f72 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Flavor limits 0:0:0 {{(pid=118712) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 01 04:13:31.984219 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.virt.hardware [None req-34a1615a-60ed-4d2d-830c-214e53889f72 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Image limits 0:0:0 {{(pid=118712) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 01 04:13:31.984777 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.virt.hardware [None req-34a1615a-60ed-4d2d-830c-214e53889f72 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Flavor pref 0:0:0 {{(pid=118712) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 01 04:13:31.985190 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.virt.hardware [None req-34a1615a-60ed-4d2d-830c-214e53889f72 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Image pref 0:0:0 {{(pid=118712) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 01 04:13:31.985602 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.virt.hardware [None req-34a1615a-60ed-4d2d-830c-214e53889f72 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118712) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 01 04:13:31.994739 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-34a1615a-60ed-4d2d-830c-214e53889f72 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:13:31.995194 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-34a1615a-60ed-4d2d-830c-214e53889f72 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:13:31.996035 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-34a1615a-60ed-4d2d-830c-214e53889f72 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:13:31.996480 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-34a1615a-60ed-4d2d-830c-214e53889f72 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:13:32.013970 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.quota [None req-34a1615a-60ed-4d2d-830c-214e53889f72 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Getting quotas for project da99a87350634e9ea8a89f314f5e6118. Resources: {'ram', 'cores', 'instances'} {{(pid=118712) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 04:13:32.018625 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.quota [None req-34a1615a-60ed-4d2d-830c-214e53889f72 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Getting quotas for user 2e9707561b4a4811bd7a7d3fed4fcd6b and project da99a87350634e9ea8a89f314f5e6118. Resources: {'ram', 'cores', 'instances'} {{(pid=118712) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 04:13:32.081306 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-34a1615a-60ed-4d2d-830c-214e53889f72 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Going to run 1 instances... {{(pid=118712) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 01 04:13:32.083414 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-34a1615a-60ed-4d2d-830c-214e53889f72 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] [instance: f2e7c278-8bf2-46c0-bc52-bc071ad88b64] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='37639f3f-fc49-4fa3-b2ee-84f6a2898b17',volume_size=None,volume_type=None)] {{(pid=118712) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 01 04:13:32.581571 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-34a1615a-60ed-4d2d-830c-214e53889f72 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.109434 Jul 01 04:13:32.583200 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 411/815] 10.222.0.20 () {60 vars in 1146 bytes} [Fri Jul 1 04:13:31 2022] POST /compute/v2.1/servers => generated 405 bytes in 1112 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 01 04:13:32.595414 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-8bcfcbcd-3c0f-4857-8cea-fe17407f0b34 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:13:32.596196 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-8bcfcbcd-3c0f-4857-8cea-fe17407f0b34 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] [instance: f2e7c278-8bf2-46c0-bc52-bc071ad88b64] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:13:32.645236 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-15d742a5-eb6c-495b-a3cf-83f34f34e941 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:13:32.645861 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-15d742a5-eb6c-495b-a3cf-83f34f34e941 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] [instance: 2e5d1edc-dbae-41dd-ab34-aa954b62f390] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:13:32.652082 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-8bcfcbcd-3c0f-4857-8cea-fe17407f0b34 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e9707561b4a4811bd7a7d3fed4fcd6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da99a87350634e9ea8a89f314f5e6118', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:13:32.652671 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-15d742a5-eb6c-495b-a3cf-83f34f34e941 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:13:32.653138 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-15d742a5-eb6c-495b-a3cf-83f34f34e941 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:13:32.653985 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-15d742a5-eb6c-495b-a3cf-83f34f34e941 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:13:32.654464 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-15d742a5-eb6c-495b-a3cf-83f34f34e941 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:13:32.660235 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-8bcfcbcd-3c0f-4857-8cea-fe17407f0b34 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] 10.222.0.20 "GET /compute/v2.1/servers/f2e7c278-8bf2-46c0-bc52-bc071ad88b64" status: 200 len: 1094 microversion: 2.1 time: 0.069475 Jul 01 04:13:32.669802 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 405/816] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:13:32 2022] GET /compute/v2.1/servers/f2e7c278-8bf2-46c0-bc52-bc071ad88b64 => generated 1094 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:13:32.823812 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-15d742a5-eb6c-495b-a3cf-83f34f34e941 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73d76a988462431fa6bb03dca64463a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9614129d1e864c3ea288aaac8387c5d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:13:32.832278 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-15d742a5-eb6c-495b-a3cf-83f34f34e941 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] 10.222.0.20 "GET /compute/v2.1/servers/2e5d1edc-dbae-41dd-ab34-aa954b62f390" status: 200 len: 1722 microversion: 2.1 time: 0.190757 Jul 01 04:13:32.832920 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 412/817] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:13:32 2022] GET /compute/v2.1/servers/2e5d1edc-dbae-41dd-ab34-aa954b62f390 => generated 1722 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 04:13:33.677745 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-1a2fda57-53b1-4727-a115-d222f7441ce1 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:13:33.678652 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-1a2fda57-53b1-4727-a115-d222f7441ce1 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] [instance: f2e7c278-8bf2-46c0-bc52-bc071ad88b64] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:13:33.686046 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-1a2fda57-53b1-4727-a115-d222f7441ce1 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:13:33.686497 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-1a2fda57-53b1-4727-a115-d222f7441ce1 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:13:33.687310 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-1a2fda57-53b1-4727-a115-d222f7441ce1 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:13:33.687768 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-1a2fda57-53b1-4727-a115-d222f7441ce1 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:13:33.755583 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-1a2fda57-53b1-4727-a115-d222f7441ce1 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e9707561b4a4811bd7a7d3fed4fcd6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da99a87350634e9ea8a89f314f5e6118', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:13:33.763591 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-1a2fda57-53b1-4727-a115-d222f7441ce1 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] 10.222.0.20 "GET /compute/v2.1/servers/f2e7c278-8bf2-46c0-bc52-bc071ad88b64" status: 200 len: 1144 microversion: 2.1 time: 0.089658 Jul 01 04:13:33.764601 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 406/818] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:13:33 2022] GET /compute/v2.1/servers/f2e7c278-8bf2-46c0-bc52-bc071ad88b64 => generated 1144 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:13:33.851973 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-3307f4e5-fa48-48db-8e13-ee0c7da8afbd tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:13:33.852740 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-3307f4e5-fa48-48db-8e13-ee0c7da8afbd tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] [instance: 2e5d1edc-dbae-41dd-ab34-aa954b62f390] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:13:33.859643 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-3307f4e5-fa48-48db-8e13-ee0c7da8afbd tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:13:33.860100 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-3307f4e5-fa48-48db-8e13-ee0c7da8afbd tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:13:33.861415 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-3307f4e5-fa48-48db-8e13-ee0c7da8afbd tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:13:33.861853 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-3307f4e5-fa48-48db-8e13-ee0c7da8afbd tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:13:34.023000 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-3307f4e5-fa48-48db-8e13-ee0c7da8afbd tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73d76a988462431fa6bb03dca64463a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9614129d1e864c3ea288aaac8387c5d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:13:34.031444 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-3307f4e5-fa48-48db-8e13-ee0c7da8afbd tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] 10.222.0.20 "GET /compute/v2.1/servers/2e5d1edc-dbae-41dd-ab34-aa954b62f390" status: 200 len: 1722 microversion: 2.1 time: 0.185507 Jul 01 04:13:34.032670 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 413/819] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:13:33 2022] GET /compute/v2.1/servers/2e5d1edc-dbae-41dd-ab34-aa954b62f390 => generated 1722 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:13:34.780569 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-e7661ba8-0c3e-44cd-bbe9-1dce14ba368f tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:13:34.781180 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-e7661ba8-0c3e-44cd-bbe9-1dce14ba368f tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] [instance: f2e7c278-8bf2-46c0-bc52-bc071ad88b64] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:13:34.788543 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-e7661ba8-0c3e-44cd-bbe9-1dce14ba368f tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:13:34.788998 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-e7661ba8-0c3e-44cd-bbe9-1dce14ba368f tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:13:34.789765 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-e7661ba8-0c3e-44cd-bbe9-1dce14ba368f tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:13:34.790204 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-e7661ba8-0c3e-44cd-bbe9-1dce14ba368f tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:13:34.855259 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-e7661ba8-0c3e-44cd-bbe9-1dce14ba368f tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e9707561b4a4811bd7a7d3fed4fcd6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da99a87350634e9ea8a89f314f5e6118', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:13:34.863258 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-e7661ba8-0c3e-44cd-bbe9-1dce14ba368f tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] 10.222.0.20 "GET /compute/v2.1/servers/f2e7c278-8bf2-46c0-bc52-bc071ad88b64" status: 200 len: 1210 microversion: 2.1 time: 0.086481 Jul 01 04:13:34.863819 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 407/820] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:13:34 2022] GET /compute/v2.1/servers/f2e7c278-8bf2-46c0-bc52-bc071ad88b64 => generated 1210 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:13:35.049460 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-c646e4f7-d1df-44cf-b2e7-8909ef521e06 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:13:35.050274 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-c646e4f7-d1df-44cf-b2e7-8909ef521e06 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] [instance: 2e5d1edc-dbae-41dd-ab34-aa954b62f390] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:13:35.056621 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-c646e4f7-d1df-44cf-b2e7-8909ef521e06 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:13:35.057079 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-c646e4f7-d1df-44cf-b2e7-8909ef521e06 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:13:35.057894 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-c646e4f7-d1df-44cf-b2e7-8909ef521e06 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:13:35.058295 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-c646e4f7-d1df-44cf-b2e7-8909ef521e06 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:13:35.196579 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-c646e4f7-d1df-44cf-b2e7-8909ef521e06 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73d76a988462431fa6bb03dca64463a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9614129d1e864c3ea288aaac8387c5d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:13:35.204946 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-c646e4f7-d1df-44cf-b2e7-8909ef521e06 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] 10.222.0.20 "GET /compute/v2.1/servers/2e5d1edc-dbae-41dd-ab34-aa954b62f390" status: 200 len: 1722 microversion: 2.1 time: 0.159787 Jul 01 04:13:35.205526 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 414/821] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:13:35 2022] GET /compute/v2.1/servers/2e5d1edc-dbae-41dd-ab34-aa954b62f390 => generated 1722 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:13:35.883631 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-ea8661f3-575d-44a7-9e0b-43787ab0efc4 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:13:35.884596 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-ea8661f3-575d-44a7-9e0b-43787ab0efc4 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] [instance: f2e7c278-8bf2-46c0-bc52-bc071ad88b64] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:13:35.892761 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-ea8661f3-575d-44a7-9e0b-43787ab0efc4 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:13:35.893496 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-ea8661f3-575d-44a7-9e0b-43787ab0efc4 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:13:35.894718 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-ea8661f3-575d-44a7-9e0b-43787ab0efc4 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:13:35.895592 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-ea8661f3-575d-44a7-9e0b-43787ab0efc4 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:13:36.069181 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-ea8661f3-575d-44a7-9e0b-43787ab0efc4 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e9707561b4a4811bd7a7d3fed4fcd6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da99a87350634e9ea8a89f314f5e6118', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:13:36.077739 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-ea8661f3-575d-44a7-9e0b-43787ab0efc4 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] 10.222.0.20 "GET /compute/v2.1/servers/f2e7c278-8bf2-46c0-bc52-bc071ad88b64" status: 200 len: 1277 microversion: 2.1 time: 0.198764 Jul 01 04:13:36.078667 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 408/822] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:13:35 2022] GET /compute/v2.1/servers/f2e7c278-8bf2-46c0-bc52-bc071ad88b64 => generated 1277 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:13:36.222990 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-15aaa20a-3e5f-43ad-83b5-fca8cb9a9609 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:13:36.223652 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-15aaa20a-3e5f-43ad-83b5-fca8cb9a9609 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] [instance: 2e5d1edc-dbae-41dd-ab34-aa954b62f390] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:13:36.230754 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-15aaa20a-3e5f-43ad-83b5-fca8cb9a9609 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:13:36.231213 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-15aaa20a-3e5f-43ad-83b5-fca8cb9a9609 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:13:36.232485 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-15aaa20a-3e5f-43ad-83b5-fca8cb9a9609 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:13:36.232932 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-15aaa20a-3e5f-43ad-83b5-fca8cb9a9609 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:13:36.381041 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-15aaa20a-3e5f-43ad-83b5-fca8cb9a9609 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73d76a988462431fa6bb03dca64463a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9614129d1e864c3ea288aaac8387c5d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:13:36.389401 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-15aaa20a-3e5f-43ad-83b5-fca8cb9a9609 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] 10.222.0.20 "GET /compute/v2.1/servers/2e5d1edc-dbae-41dd-ab34-aa954b62f390" status: 200 len: 1722 microversion: 2.1 time: 0.171094 Jul 01 04:13:36.389991 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 415/823] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:13:36 2022] GET /compute/v2.1/servers/2e5d1edc-dbae-41dd-ab34-aa954b62f390 => generated 1722 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:13:36.508408 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [req-3b3e612f-1194-41cb-88b1-fdb519c91e1a req-e8c8b50b-c6a8-4ef8-a40b-480ceb091acd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f2e7c278-8bf2-46c0-bc52-bc071ad88b64", "tag": "57abeebd-e852-43c8-80de-3c0e6f925ab3"}]} {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 04:13:36.518783 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [req-3b3e612f-1194-41cb-88b1-fdb519c91e1a req-e8c8b50b-c6a8-4ef8-a40b-480ceb091acd service nova] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:13:36.519541 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [req-3b3e612f-1194-41cb-88b1-fdb519c91e1a req-e8c8b50b-c6a8-4ef8-a40b-480ceb091acd service nova] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:13:36.534186 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.compute.server_external_events [req-3b3e612f-1194-41cb-88b1-fdb519c91e1a req-e8c8b50b-c6a8-4ef8-a40b-480ceb091acd service nova] Creating event network-changed:57abeebd-e852-43c8-80de-3c0e6f925ab3 for instance f2e7c278-8bf2-46c0-bc52-bc071ad88b64 on hv-cinder-84684 Jul 01 04:13:36.540175 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [req-3b3e612f-1194-41cb-88b1-fdb519c91e1a req-e8c8b50b-c6a8-4ef8-a40b-480ceb091acd service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035561 Jul 01 04:13:36.543399 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 409/824] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Jul 1 04:13:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 04:13:37.096107 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-850f12d8-68ae-4415-b1c8-b7abb6912a7d tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:13:37.100382 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-850f12d8-68ae-4415-b1c8-b7abb6912a7d tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] [instance: f2e7c278-8bf2-46c0-bc52-bc071ad88b64] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:13:37.103051 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-850f12d8-68ae-4415-b1c8-b7abb6912a7d tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:13:37.103595 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-850f12d8-68ae-4415-b1c8-b7abb6912a7d tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:13:37.106194 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-850f12d8-68ae-4415-b1c8-b7abb6912a7d tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:13:37.106194 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-850f12d8-68ae-4415-b1c8-b7abb6912a7d tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:13:37.240652 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-850f12d8-68ae-4415-b1c8-b7abb6912a7d tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e9707561b4a4811bd7a7d3fed4fcd6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da99a87350634e9ea8a89f314f5e6118', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:13:37.248750 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-850f12d8-68ae-4415-b1c8-b7abb6912a7d tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] 10.222.0.20 "GET /compute/v2.1/servers/f2e7c278-8bf2-46c0-bc52-bc071ad88b64" status: 200 len: 1265 microversion: 2.1 time: 0.156895 Jul 01 04:13:37.249333 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 416/825] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:13:37 2022] GET /compute/v2.1/servers/f2e7c278-8bf2-46c0-bc52-bc071ad88b64 => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 04:13:37.411537 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-6fadd42e-eb31-4346-a16b-eee3f4c2aef6 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:13:37.412572 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-6fadd42e-eb31-4346-a16b-eee3f4c2aef6 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] [instance: 2e5d1edc-dbae-41dd-ab34-aa954b62f390] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:13:37.420287 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-6fadd42e-eb31-4346-a16b-eee3f4c2aef6 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:13:37.420834 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-6fadd42e-eb31-4346-a16b-eee3f4c2aef6 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:13:37.422152 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-6fadd42e-eb31-4346-a16b-eee3f4c2aef6 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:13:37.422755 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-6fadd42e-eb31-4346-a16b-eee3f4c2aef6 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:13:37.588955 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-6fadd42e-eb31-4346-a16b-eee3f4c2aef6 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73d76a988462431fa6bb03dca64463a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9614129d1e864c3ea288aaac8387c5d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:13:37.600300 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-6fadd42e-eb31-4346-a16b-eee3f4c2aef6 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] 10.222.0.20 "GET /compute/v2.1/servers/2e5d1edc-dbae-41dd-ab34-aa954b62f390" status: 200 len: 1722 microversion: 2.1 time: 0.195797 Jul 01 04:13:37.601004 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 410/826] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:13:37 2022] GET /compute/v2.1/servers/2e5d1edc-dbae-41dd-ab34-aa954b62f390 => generated 1722 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:13:38.266021 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-927122ef-08be-466b-accc-8b01646ef7c0 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:13:38.266734 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-927122ef-08be-466b-accc-8b01646ef7c0 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] [instance: f2e7c278-8bf2-46c0-bc52-bc071ad88b64] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:13:38.273475 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-927122ef-08be-466b-accc-8b01646ef7c0 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:13:38.273937 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-927122ef-08be-466b-accc-8b01646ef7c0 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:13:38.274730 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-927122ef-08be-466b-accc-8b01646ef7c0 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:13:38.275180 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-927122ef-08be-466b-accc-8b01646ef7c0 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:13:38.414217 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-927122ef-08be-466b-accc-8b01646ef7c0 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e9707561b4a4811bd7a7d3fed4fcd6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da99a87350634e9ea8a89f314f5e6118', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:13:38.422110 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-927122ef-08be-466b-accc-8b01646ef7c0 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] 10.222.0.20 "GET /compute/v2.1/servers/f2e7c278-8bf2-46c0-bc52-bc071ad88b64" status: 200 len: 1265 microversion: 2.1 time: 0.159956 Jul 01 04:13:38.423218 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 417/827] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:13:38 2022] GET /compute/v2.1/servers/f2e7c278-8bf2-46c0-bc52-bc071ad88b64 => generated 1265 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:13:38.617738 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-52edc73a-886f-43a5-8bbf-f46abe17d98e tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:13:38.618269 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-52edc73a-886f-43a5-8bbf-f46abe17d98e tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] [instance: 2e5d1edc-dbae-41dd-ab34-aa954b62f390] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:13:38.624723 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-52edc73a-886f-43a5-8bbf-f46abe17d98e tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:13:38.625167 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-52edc73a-886f-43a5-8bbf-f46abe17d98e tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:13:38.625945 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-52edc73a-886f-43a5-8bbf-f46abe17d98e tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:13:38.626383 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-52edc73a-886f-43a5-8bbf-f46abe17d98e tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:13:38.761053 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-52edc73a-886f-43a5-8bbf-f46abe17d98e tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73d76a988462431fa6bb03dca64463a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9614129d1e864c3ea288aaac8387c5d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:13:38.769138 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-52edc73a-886f-43a5-8bbf-f46abe17d98e tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] 10.222.0.20 "GET /compute/v2.1/servers/2e5d1edc-dbae-41dd-ab34-aa954b62f390" status: 200 len: 1722 microversion: 2.1 time: 0.155300 Jul 01 04:13:38.769802 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 411/828] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:13:38 2022] GET /compute/v2.1/servers/2e5d1edc-dbae-41dd-ab34-aa954b62f390 => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:13:39.439871 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-14fffb9c-a9dc-4610-8608-f23bbdb316e7 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:13:39.440509 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-14fffb9c-a9dc-4610-8608-f23bbdb316e7 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] [instance: f2e7c278-8bf2-46c0-bc52-bc071ad88b64] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:13:39.447548 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-14fffb9c-a9dc-4610-8608-f23bbdb316e7 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:13:39.448011 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-14fffb9c-a9dc-4610-8608-f23bbdb316e7 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:13:39.448803 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-14fffb9c-a9dc-4610-8608-f23bbdb316e7 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:13:39.449252 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-14fffb9c-a9dc-4610-8608-f23bbdb316e7 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:13:39.583046 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-14fffb9c-a9dc-4610-8608-f23bbdb316e7 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e9707561b4a4811bd7a7d3fed4fcd6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da99a87350634e9ea8a89f314f5e6118', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:13:39.593872 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-14fffb9c-a9dc-4610-8608-f23bbdb316e7 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] 10.222.0.20 "GET /compute/v2.1/servers/f2e7c278-8bf2-46c0-bc52-bc071ad88b64" status: 200 len: 1265 microversion: 2.1 time: 0.158010 Jul 01 04:13:39.594947 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 418/829] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:13:39 2022] GET /compute/v2.1/servers/f2e7c278-8bf2-46c0-bc52-bc071ad88b64 => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:13:39.786892 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-55102841-43e5-4c11-90ce-fe1815689566 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:13:39.787534 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-55102841-43e5-4c11-90ce-fe1815689566 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] [instance: 2e5d1edc-dbae-41dd-ab34-aa954b62f390] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:13:39.794366 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-55102841-43e5-4c11-90ce-fe1815689566 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:13:39.794882 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-55102841-43e5-4c11-90ce-fe1815689566 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:13:39.795711 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-55102841-43e5-4c11-90ce-fe1815689566 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:13:39.796206 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-55102841-43e5-4c11-90ce-fe1815689566 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:13:39.925932 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-55102841-43e5-4c11-90ce-fe1815689566 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73d76a988462431fa6bb03dca64463a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9614129d1e864c3ea288aaac8387c5d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:13:39.933793 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-55102841-43e5-4c11-90ce-fe1815689566 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] 10.222.0.20 "GET /compute/v2.1/servers/2e5d1edc-dbae-41dd-ab34-aa954b62f390" status: 200 len: 1722 microversion: 2.1 time: 0.151485 Jul 01 04:13:39.934362 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 412/830] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:13:39 2022] GET /compute/v2.1/servers/2e5d1edc-dbae-41dd-ab34-aa954b62f390 => generated 1722 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:13:40.612217 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-e2c671fe-27a9-4c60-b51a-a61105d5a0db tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:13:40.612872 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-e2c671fe-27a9-4c60-b51a-a61105d5a0db tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] [instance: f2e7c278-8bf2-46c0-bc52-bc071ad88b64] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:13:40.619495 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-e2c671fe-27a9-4c60-b51a-a61105d5a0db tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:13:40.620023 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-e2c671fe-27a9-4c60-b51a-a61105d5a0db tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:13:40.620741 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-e2c671fe-27a9-4c60-b51a-a61105d5a0db tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:13:40.621184 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-e2c671fe-27a9-4c60-b51a-a61105d5a0db tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:13:40.761796 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-e2c671fe-27a9-4c60-b51a-a61105d5a0db tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e9707561b4a4811bd7a7d3fed4fcd6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da99a87350634e9ea8a89f314f5e6118', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:13:40.770403 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-e2c671fe-27a9-4c60-b51a-a61105d5a0db tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] 10.222.0.20 "GET /compute/v2.1/servers/f2e7c278-8bf2-46c0-bc52-bc071ad88b64" status: 200 len: 1265 microversion: 2.1 time: 0.162587 Jul 01 04:13:40.770972 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 419/831] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:13:40 2022] GET /compute/v2.1/servers/f2e7c278-8bf2-46c0-bc52-bc071ad88b64 => generated 1265 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:13:40.951166 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-507c3935-dd42-448e-b672-13ca78076c3d tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:13:40.951757 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-507c3935-dd42-448e-b672-13ca78076c3d tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] [instance: 2e5d1edc-dbae-41dd-ab34-aa954b62f390] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:13:40.958176 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-507c3935-dd42-448e-b672-13ca78076c3d tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:13:40.958628 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-507c3935-dd42-448e-b672-13ca78076c3d tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:13:40.959426 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-507c3935-dd42-448e-b672-13ca78076c3d tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:13:40.959856 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-507c3935-dd42-448e-b672-13ca78076c3d tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:13:41.093635 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-507c3935-dd42-448e-b672-13ca78076c3d tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73d76a988462431fa6bb03dca64463a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9614129d1e864c3ea288aaac8387c5d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:13:41.102501 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-507c3935-dd42-448e-b672-13ca78076c3d tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] 10.222.0.20 "GET /compute/v2.1/servers/2e5d1edc-dbae-41dd-ab34-aa954b62f390" status: 200 len: 1722 microversion: 2.1 time: 0.155234 Jul 01 04:13:41.103081 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 413/832] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:13:40 2022] GET /compute/v2.1/servers/2e5d1edc-dbae-41dd-ab34-aa954b62f390 => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:13:41.790041 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-9a70134e-5c3d-4191-8eaa-cfaf0fe70e3b tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:13:41.790674 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-9a70134e-5c3d-4191-8eaa-cfaf0fe70e3b tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] [instance: f2e7c278-8bf2-46c0-bc52-bc071ad88b64] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:13:41.798763 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-9a70134e-5c3d-4191-8eaa-cfaf0fe70e3b tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:13:41.799215 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-9a70134e-5c3d-4191-8eaa-cfaf0fe70e3b tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:13:41.800022 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-9a70134e-5c3d-4191-8eaa-cfaf0fe70e3b tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:13:41.800469 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-9a70134e-5c3d-4191-8eaa-cfaf0fe70e3b tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:13:41.936436 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-9a70134e-5c3d-4191-8eaa-cfaf0fe70e3b tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e9707561b4a4811bd7a7d3fed4fcd6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da99a87350634e9ea8a89f314f5e6118', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:13:41.945277 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-9a70134e-5c3d-4191-8eaa-cfaf0fe70e3b tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] 10.222.0.20 "GET /compute/v2.1/servers/f2e7c278-8bf2-46c0-bc52-bc071ad88b64" status: 200 len: 1265 microversion: 2.1 time: 0.159114 Jul 01 04:13:41.945857 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 420/833] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:13:41 2022] GET /compute/v2.1/servers/f2e7c278-8bf2-46c0-bc52-bc071ad88b64 => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:13:42.120095 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-93224a6f-6e97-4171-a7ba-1c910f946b7c tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:13:42.120765 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-93224a6f-6e97-4171-a7ba-1c910f946b7c tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] [instance: 2e5d1edc-dbae-41dd-ab34-aa954b62f390] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:13:42.128847 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-93224a6f-6e97-4171-a7ba-1c910f946b7c tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:13:42.129301 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-93224a6f-6e97-4171-a7ba-1c910f946b7c tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:13:42.130098 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-93224a6f-6e97-4171-a7ba-1c910f946b7c tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:13:42.130529 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-93224a6f-6e97-4171-a7ba-1c910f946b7c tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:13:42.259610 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-93224a6f-6e97-4171-a7ba-1c910f946b7c tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73d76a988462431fa6bb03dca64463a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9614129d1e864c3ea288aaac8387c5d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:13:42.267950 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-93224a6f-6e97-4171-a7ba-1c910f946b7c tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] 10.222.0.20 "GET /compute/v2.1/servers/2e5d1edc-dbae-41dd-ab34-aa954b62f390" status: 200 len: 1722 microversion: 2.1 time: 0.151653 Jul 01 04:13:42.268525 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 414/834] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:13:42 2022] GET /compute/v2.1/servers/2e5d1edc-dbae-41dd-ab34-aa954b62f390 => generated 1722 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:13:42.962382 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-3c97fc19-e8fa-4e6f-af63-ac2869d3b43e tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:13:42.962944 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-3c97fc19-e8fa-4e6f-af63-ac2869d3b43e tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] [instance: f2e7c278-8bf2-46c0-bc52-bc071ad88b64] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:13:42.964903 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG dbcounter [-] [118712] Writing DB stats nova_cell0:SELECT=2 {{(pid=118712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:13:42.965585 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG dbcounter [-] [118712] Writing DB stats nova_cell0:SELECT=6 {{(pid=118712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:13:42.971141 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-3c97fc19-e8fa-4e6f-af63-ac2869d3b43e tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:13:42.971665 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-3c97fc19-e8fa-4e6f-af63-ac2869d3b43e tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:13:42.972501 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-3c97fc19-e8fa-4e6f-af63-ac2869d3b43e tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:13:42.976474 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-3c97fc19-e8fa-4e6f-af63-ac2869d3b43e tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:13:43.110031 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-3c97fc19-e8fa-4e6f-af63-ac2869d3b43e tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e9707561b4a4811bd7a7d3fed4fcd6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da99a87350634e9ea8a89f314f5e6118', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:13:43.118064 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-3c97fc19-e8fa-4e6f-af63-ac2869d3b43e tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] 10.222.0.20 "GET /compute/v2.1/servers/f2e7c278-8bf2-46c0-bc52-bc071ad88b64" status: 200 len: 1265 microversion: 2.1 time: 0.159689 Jul 01 04:13:43.118625 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 421/835] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:13:42 2022] GET /compute/v2.1/servers/f2e7c278-8bf2-46c0-bc52-bc071ad88b64 => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 04:13:43.285542 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-90003a3e-2b54-41ca-9f6f-a3eee04a0fd3 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:13:43.286148 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-90003a3e-2b54-41ca-9f6f-a3eee04a0fd3 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] [instance: 2e5d1edc-dbae-41dd-ab34-aa954b62f390] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:13:43.288127 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG dbcounter [-] [118711] Writing DB stats nova_cell0:SELECT=2 {{(pid=118711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:13:43.293529 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-90003a3e-2b54-41ca-9f6f-a3eee04a0fd3 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:13:43.297168 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-90003a3e-2b54-41ca-9f6f-a3eee04a0fd3 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:13:43.297168 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-90003a3e-2b54-41ca-9f6f-a3eee04a0fd3 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:13:43.297168 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-90003a3e-2b54-41ca-9f6f-a3eee04a0fd3 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:13:43.446182 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-90003a3e-2b54-41ca-9f6f-a3eee04a0fd3 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73d76a988462431fa6bb03dca64463a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9614129d1e864c3ea288aaac8387c5d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:13:43.455377 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-90003a3e-2b54-41ca-9f6f-a3eee04a0fd3 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] 10.222.0.20 "GET /compute/v2.1/servers/2e5d1edc-dbae-41dd-ab34-aa954b62f390" status: 200 len: 1722 microversion: 2.1 time: 0.174078 Jul 01 04:13:43.455980 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 415/836] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:13:43 2022] GET /compute/v2.1/servers/2e5d1edc-dbae-41dd-ab34-aa954b62f390 => generated 1722 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:13:44.134619 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-4ee478f9-d60c-47d5-909e-0dbb79f755c8 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:13:44.135185 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-4ee478f9-d60c-47d5-909e-0dbb79f755c8 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] [instance: f2e7c278-8bf2-46c0-bc52-bc071ad88b64] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:13:44.141203 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-4ee478f9-d60c-47d5-909e-0dbb79f755c8 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:13:44.141668 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-4ee478f9-d60c-47d5-909e-0dbb79f755c8 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:13:44.143022 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-4ee478f9-d60c-47d5-909e-0dbb79f755c8 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:13:44.143690 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-4ee478f9-d60c-47d5-909e-0dbb79f755c8 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:13:44.309476 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-4ee478f9-d60c-47d5-909e-0dbb79f755c8 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e9707561b4a4811bd7a7d3fed4fcd6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da99a87350634e9ea8a89f314f5e6118', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:13:44.318321 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-4ee478f9-d60c-47d5-909e-0dbb79f755c8 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] 10.222.0.20 "GET /compute/v2.1/servers/f2e7c278-8bf2-46c0-bc52-bc071ad88b64" status: 200 len: 1265 microversion: 2.1 time: 0.188037 Jul 01 04:13:44.318945 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 422/837] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:13:44 2022] GET /compute/v2.1/servers/f2e7c278-8bf2-46c0-bc52-bc071ad88b64 => generated 1265 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:13:44.475993 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-dddab141-6ee3-4f85-92d0-141418370130 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:13:44.476603 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-dddab141-6ee3-4f85-92d0-141418370130 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] [instance: 2e5d1edc-dbae-41dd-ab34-aa954b62f390] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:13:44.483109 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-dddab141-6ee3-4f85-92d0-141418370130 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:13:44.483602 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-dddab141-6ee3-4f85-92d0-141418370130 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:13:44.484402 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-dddab141-6ee3-4f85-92d0-141418370130 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:13:44.484849 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-dddab141-6ee3-4f85-92d0-141418370130 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:13:44.505554 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG dbcounter [-] [118711] Writing DB stats nova_cell1:SELECT=100 {{(pid=118711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:13:44.621523 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-dddab141-6ee3-4f85-92d0-141418370130 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73d76a988462431fa6bb03dca64463a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9614129d1e864c3ea288aaac8387c5d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:13:44.630456 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-dddab141-6ee3-4f85-92d0-141418370130 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] 10.222.0.20 "GET /compute/v2.1/servers/2e5d1edc-dbae-41dd-ab34-aa954b62f390" status: 200 len: 1699 microversion: 2.1 time: 0.158293 Jul 01 04:13:44.631039 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 416/838] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:13:44 2022] GET /compute/v2.1/servers/2e5d1edc-dbae-41dd-ab34-aa954b62f390 => generated 1699 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:13:44.647687 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-45d1de63-2e65-465f-8ffa-d8a8bd4dd3c5 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 04:13:44.653831 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-45d1de63-2e65-465f-8ffa-d8a8bd4dd3c5 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:13:44.654314 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-45d1de63-2e65-465f-8ffa-d8a8bd4dd3c5 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:13:44.677815 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-45d1de63-2e65-465f-8ffa-d8a8bd4dd3c5 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] [instance: 2e5d1edc-dbae-41dd-ab34-aa954b62f390] Going to try to start instance {{(pid=118712) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 01 04:13:44.855301 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-45d1de63-2e65-465f-8ffa-d8a8bd4dd3c5 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] 10.222.0.20 "POST /compute/v2.1/servers/2e5d1edc-dbae-41dd-ab34-aa954b62f390/action" status: 202 len: 0 microversion: 2.1 time: 0.211302 Jul 01 04:13:44.855836 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 423/839] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Jul 1 04:13:44 2022] POST /compute/v2.1/servers/2e5d1edc-dbae-41dd-ab34-aa954b62f390/action => generated 0 bytes in 213 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 04:13:44.864188 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-0c8e1a36-a96d-4bd1-b838-1e19c0c99da2 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:13:44.870289 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-0c8e1a36-a96d-4bd1-b838-1e19c0c99da2 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] [instance: 2e5d1edc-dbae-41dd-ab34-aa954b62f390] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:13:44.871048 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-0c8e1a36-a96d-4bd1-b838-1e19c0c99da2 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:13:44.871594 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-0c8e1a36-a96d-4bd1-b838-1e19c0c99da2 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:13:44.872393 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-0c8e1a36-a96d-4bd1-b838-1e19c0c99da2 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:13:44.872825 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-0c8e1a36-a96d-4bd1-b838-1e19c0c99da2 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:13:45.030692 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-0c8e1a36-a96d-4bd1-b838-1e19c0c99da2 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73d76a988462431fa6bb03dca64463a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9614129d1e864c3ea288aaac8387c5d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:13:45.040189 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-0c8e1a36-a96d-4bd1-b838-1e19c0c99da2 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] 10.222.0.20 "GET /compute/v2.1/servers/2e5d1edc-dbae-41dd-ab34-aa954b62f390" status: 200 len: 1708 microversion: 2.1 time: 0.179965 Jul 01 04:13:45.040794 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 417/840] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:13:44 2022] GET /compute/v2.1/servers/2e5d1edc-dbae-41dd-ab34-aa954b62f390 => generated 1708 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:13:45.339928 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-1ffcb30a-f20a-400f-b17e-f94d8b2b25f9 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:13:45.340648 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-1ffcb30a-f20a-400f-b17e-f94d8b2b25f9 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] [instance: f2e7c278-8bf2-46c0-bc52-bc071ad88b64] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:13:45.347682 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-1ffcb30a-f20a-400f-b17e-f94d8b2b25f9 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:13:45.352166 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-1ffcb30a-f20a-400f-b17e-f94d8b2b25f9 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:13:45.352166 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-1ffcb30a-f20a-400f-b17e-f94d8b2b25f9 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:13:45.352166 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-1ffcb30a-f20a-400f-b17e-f94d8b2b25f9 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:13:45.365632 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG dbcounter [-] [118712] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:13:45.517567 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-1ffcb30a-f20a-400f-b17e-f94d8b2b25f9 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e9707561b4a4811bd7a7d3fed4fcd6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da99a87350634e9ea8a89f314f5e6118', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:13:45.526060 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-1ffcb30a-f20a-400f-b17e-f94d8b2b25f9 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] 10.222.0.20 "GET /compute/v2.1/servers/f2e7c278-8bf2-46c0-bc52-bc071ad88b64" status: 200 len: 1265 microversion: 2.1 time: 0.191116 Jul 01 04:13:45.526660 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 424/841] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:13:45 2022] GET /compute/v2.1/servers/f2e7c278-8bf2-46c0-bc52-bc071ad88b64 => generated 1265 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 04:13:46.057948 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-f244051a-4e93-4e48-8d53-0f6776632378 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:13:46.058675 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-f244051a-4e93-4e48-8d53-0f6776632378 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] [instance: 2e5d1edc-dbae-41dd-ab34-aa954b62f390] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:13:46.065725 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-f244051a-4e93-4e48-8d53-0f6776632378 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:13:46.066177 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-f244051a-4e93-4e48-8d53-0f6776632378 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:13:46.067030 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-f244051a-4e93-4e48-8d53-0f6776632378 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:13:46.067653 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-f244051a-4e93-4e48-8d53-0f6776632378 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:13:46.225388 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-f244051a-4e93-4e48-8d53-0f6776632378 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73d76a988462431fa6bb03dca64463a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9614129d1e864c3ea288aaac8387c5d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:13:46.233891 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-f244051a-4e93-4e48-8d53-0f6776632378 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] 10.222.0.20 "GET /compute/v2.1/servers/2e5d1edc-dbae-41dd-ab34-aa954b62f390" status: 200 len: 1708 microversion: 2.1 time: 0.179769 Jul 01 04:13:46.234469 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 418/842] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:13:46 2022] GET /compute/v2.1/servers/2e5d1edc-dbae-41dd-ab34-aa954b62f390 => generated 1708 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:13:46.544862 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-f8be6fd9-723e-44a5-913b-74fa94176976 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:13:46.545420 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-f8be6fd9-723e-44a5-913b-74fa94176976 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] [instance: f2e7c278-8bf2-46c0-bc52-bc071ad88b64] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:13:46.552775 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-f8be6fd9-723e-44a5-913b-74fa94176976 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:13:46.553232 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-f8be6fd9-723e-44a5-913b-74fa94176976 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:13:46.554010 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-f8be6fd9-723e-44a5-913b-74fa94176976 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:13:46.554661 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-f8be6fd9-723e-44a5-913b-74fa94176976 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:13:46.704491 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-f8be6fd9-723e-44a5-913b-74fa94176976 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e9707561b4a4811bd7a7d3fed4fcd6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da99a87350634e9ea8a89f314f5e6118', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:13:46.716280 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-f8be6fd9-723e-44a5-913b-74fa94176976 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] 10.222.0.20 "GET /compute/v2.1/servers/f2e7c278-8bf2-46c0-bc52-bc071ad88b64" status: 200 len: 1265 microversion: 2.1 time: 0.175670 Jul 01 04:13:46.717188 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 425/843] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:13:46 2022] GET /compute/v2.1/servers/f2e7c278-8bf2-46c0-bc52-bc071ad88b64 => generated 1265 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:13:47.251459 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-604e614c-ceb8-4537-9c73-d96df4d64fff tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:13:47.252706 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-604e614c-ceb8-4537-9c73-d96df4d64fff tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] [instance: 2e5d1edc-dbae-41dd-ab34-aa954b62f390] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:13:47.259427 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-604e614c-ceb8-4537-9c73-d96df4d64fff tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:13:47.259883 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-604e614c-ceb8-4537-9c73-d96df4d64fff tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:13:47.260674 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-604e614c-ceb8-4537-9c73-d96df4d64fff tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:13:47.261082 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-604e614c-ceb8-4537-9c73-d96df4d64fff tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:13:47.390946 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-604e614c-ceb8-4537-9c73-d96df4d64fff tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73d76a988462431fa6bb03dca64463a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9614129d1e864c3ea288aaac8387c5d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:13:47.398897 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-604e614c-ceb8-4537-9c73-d96df4d64fff tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] 10.222.0.20 "GET /compute/v2.1/servers/2e5d1edc-dbae-41dd-ab34-aa954b62f390" status: 200 len: 1712 microversion: 2.1 time: 0.151323 Jul 01 04:13:47.399494 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 419/844] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:13:47 2022] GET /compute/v2.1/servers/2e5d1edc-dbae-41dd-ab34-aa954b62f390 => generated 1712 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:13:47.733531 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-5d7d9869-85b9-4e3c-80ca-81a0fe28c9bf tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:13:47.734277 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-5d7d9869-85b9-4e3c-80ca-81a0fe28c9bf tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] [instance: f2e7c278-8bf2-46c0-bc52-bc071ad88b64] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:13:47.740868 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-5d7d9869-85b9-4e3c-80ca-81a0fe28c9bf tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:13:47.741327 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-5d7d9869-85b9-4e3c-80ca-81a0fe28c9bf tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:13:47.742112 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-5d7d9869-85b9-4e3c-80ca-81a0fe28c9bf tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:13:47.742553 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-5d7d9869-85b9-4e3c-80ca-81a0fe28c9bf tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:13:47.884185 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-5d7d9869-85b9-4e3c-80ca-81a0fe28c9bf tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e9707561b4a4811bd7a7d3fed4fcd6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da99a87350634e9ea8a89f314f5e6118', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:13:47.893137 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-5d7d9869-85b9-4e3c-80ca-81a0fe28c9bf tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] 10.222.0.20 "GET /compute/v2.1/servers/f2e7c278-8bf2-46c0-bc52-bc071ad88b64" status: 200 len: 1265 microversion: 2.1 time: 0.162748 Jul 01 04:13:47.893724 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 426/845] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:13:47 2022] GET /compute/v2.1/servers/f2e7c278-8bf2-46c0-bc52-bc071ad88b64 => generated 1265 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:13:48.284102 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [req-565688e6-90dc-47d0-8ff9-0343a1c08565 req-41f096fb-c887-409f-a0d9-b00b6052e645 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2e7c278-8bf2-46c0-bc52-bc071ad88b64", "name": "network-vif-plugged", "status": "completed", "tag": "57abeebd-e852-43c8-80de-3c0e6f925ab3"}]} {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 04:13:48.293279 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [req-565688e6-90dc-47d0-8ff9-0343a1c08565 req-41f096fb-c887-409f-a0d9-b00b6052e645 service nova] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:13:48.293735 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [req-565688e6-90dc-47d0-8ff9-0343a1c08565 req-41f096fb-c887-409f-a0d9-b00b6052e645 service nova] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:13:48.305784 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.compute.server_external_events [req-565688e6-90dc-47d0-8ff9-0343a1c08565 req-41f096fb-c887-409f-a0d9-b00b6052e645 service nova] Creating event network-vif-plugged:57abeebd-e852-43c8-80de-3c0e6f925ab3 for instance f2e7c278-8bf2-46c0-bc52-bc071ad88b64 on hv-cinder-84684 Jul 01 04:13:48.311140 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [req-565688e6-90dc-47d0-8ff9-0343a1c08565 req-41f096fb-c887-409f-a0d9-b00b6052e645 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031340 Jul 01 04:13:48.311818 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 420/846] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Jul 1 04:13:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 04:13:48.911390 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-f52df857-00ef-40e8-8e84-2d833c864fff tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:13:48.912028 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-f52df857-00ef-40e8-8e84-2d833c864fff tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] [instance: f2e7c278-8bf2-46c0-bc52-bc071ad88b64] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:13:48.918422 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-f52df857-00ef-40e8-8e84-2d833c864fff tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:13:48.918867 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-f52df857-00ef-40e8-8e84-2d833c864fff tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:13:48.919645 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-f52df857-00ef-40e8-8e84-2d833c864fff tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:13:48.920078 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-f52df857-00ef-40e8-8e84-2d833c864fff tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:13:49.053759 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-f52df857-00ef-40e8-8e84-2d833c864fff tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e9707561b4a4811bd7a7d3fed4fcd6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da99a87350634e9ea8a89f314f5e6118', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:13:49.061721 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-f52df857-00ef-40e8-8e84-2d833c864fff tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] 10.222.0.20 "GET /compute/v2.1/servers/f2e7c278-8bf2-46c0-bc52-bc071ad88b64" status: 200 len: 1265 microversion: 2.1 time: 0.154711 Jul 01 04:13:49.062303 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 427/847] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:13:48 2022] GET /compute/v2.1/servers/f2e7c278-8bf2-46c0-bc52-bc071ad88b64 => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:13:50.079683 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-4ba35e09-25e6-409e-963f-fbb7531efbc3 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:13:50.080380 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-4ba35e09-25e6-409e-963f-fbb7531efbc3 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] [instance: f2e7c278-8bf2-46c0-bc52-bc071ad88b64] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:13:50.087334 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-4ba35e09-25e6-409e-963f-fbb7531efbc3 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:13:50.087796 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-4ba35e09-25e6-409e-963f-fbb7531efbc3 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:13:50.088594 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-4ba35e09-25e6-409e-963f-fbb7531efbc3 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:13:50.089048 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-4ba35e09-25e6-409e-963f-fbb7531efbc3 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:13:50.219722 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-4ba35e09-25e6-409e-963f-fbb7531efbc3 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e9707561b4a4811bd7a7d3fed4fcd6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da99a87350634e9ea8a89f314f5e6118', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:13:50.227841 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-4ba35e09-25e6-409e-963f-fbb7531efbc3 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] 10.222.0.20 "GET /compute/v2.1/servers/f2e7c278-8bf2-46c0-bc52-bc071ad88b64" status: 200 len: 1453 microversion: 2.1 time: 0.152359 Jul 01 04:13:50.228412 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 421/848] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:13:50 2022] GET /compute/v2.1/servers/f2e7c278-8bf2-46c0-bc52-bc071ad88b64 => generated 1453 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:13:50.244046 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-82b19ac3-1071-42fe-a89e-d8dc3c0f0fb9 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:13:50.244656 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-82b19ac3-1071-42fe-a89e-d8dc3c0f0fb9 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] [instance: f2e7c278-8bf2-46c0-bc52-bc071ad88b64] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:13:50.251027 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-82b19ac3-1071-42fe-a89e-d8dc3c0f0fb9 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:13:50.251552 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-82b19ac3-1071-42fe-a89e-d8dc3c0f0fb9 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:13:50.252359 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-82b19ac3-1071-42fe-a89e-d8dc3c0f0fb9 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:13:50.252801 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-82b19ac3-1071-42fe-a89e-d8dc3c0f0fb9 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:13:50.385379 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-82b19ac3-1071-42fe-a89e-d8dc3c0f0fb9 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e9707561b4a4811bd7a7d3fed4fcd6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da99a87350634e9ea8a89f314f5e6118', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:13:50.393438 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-82b19ac3-1071-42fe-a89e-d8dc3c0f0fb9 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] 10.222.0.20 "GET /compute/v2.1/servers/f2e7c278-8bf2-46c0-bc52-bc071ad88b64" status: 200 len: 1453 microversion: 2.1 time: 0.153213 Jul 01 04:13:50.394006 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 428/849] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:13:50 2022] GET /compute/v2.1/servers/f2e7c278-8bf2-46c0-bc52-bc071ad88b64 => generated 1453 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:13:51.951431 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-2f365e84-cff1-4ac0-b55c-3f87428ba7ed tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:13:51.952033 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-2f365e84-cff1-4ac0-b55c-3f87428ba7ed tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] [instance: 0c303914-e7aa-4775-a6ae-b57f31cfe479] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:13:51.959186 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-2f365e84-cff1-4ac0-b55c-3f87428ba7ed tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:13:51.959680 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-2f365e84-cff1-4ac0-b55c-3f87428ba7ed tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:13:51.960475 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-2f365e84-cff1-4ac0-b55c-3f87428ba7ed tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:13:51.960921 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-2f365e84-cff1-4ac0-b55c-3f87428ba7ed tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:13:51.986550 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-2f365e84-cff1-4ac0-b55c-3f87428ba7ed tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] 10.222.0.20 "GET /compute/v2.1/servers/0c303914-e7aa-4775-a6ae-b57f31cfe479/ips" status: 200 len: 149 microversion: 2.1 time: 0.038630 Jul 01 04:13:51.987137 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 422/850] 10.222.0.20 () {58 vars in 1247 bytes} [Fri Jul 1 04:13:51 2022] GET /compute/v2.1/servers/0c303914-e7aa-4775-a6ae-b57f31cfe479/ips => generated 149 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 04:13:52.572388 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [req-19f62da6-f71b-4729-9257-b869ac22a679 req-c8fab5dc-3365-4dfa-b646-57f80ab2b878 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f2e7c278-8bf2-46c0-bc52-bc071ad88b64", "tag": "57abeebd-e852-43c8-80de-3c0e6f925ab3"}]} {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 04:13:52.581622 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [req-19f62da6-f71b-4729-9257-b869ac22a679 req-c8fab5dc-3365-4dfa-b646-57f80ab2b878 service nova] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:13:52.586204 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [req-19f62da6-f71b-4729-9257-b869ac22a679 req-c8fab5dc-3365-4dfa-b646-57f80ab2b878 service nova] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:13:52.594324 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.compute.server_external_events [req-19f62da6-f71b-4729-9257-b869ac22a679 req-c8fab5dc-3365-4dfa-b646-57f80ab2b878 service nova] Creating event network-changed:57abeebd-e852-43c8-80de-3c0e6f925ab3 for instance f2e7c278-8bf2-46c0-bc52-bc071ad88b64 on hv-cinder-84684 Jul 01 04:13:52.600030 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [req-19f62da6-f71b-4729-9257-b869ac22a679 req-c8fab5dc-3365-4dfa-b646-57f80ab2b878 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031124 Jul 01 04:13:52.600866 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 429/851] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Jul 1 04:13:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 04:13:53.632707 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-cc2bcd08-7079-44d8-b305-6d15b8c3e5c5 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8aeda75d-e37e-4444-a6b2-e084c2acea64"}} {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 04:13:53.634420 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-cc2bcd08-7079-44d8-b305-6d15b8c3e5c5 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] [instance: 0c303914-e7aa-4775-a6ae-b57f31cfe479] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:13:53.643061 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-cc2bcd08-7079-44d8-b305-6d15b8c3e5c5 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:13:53.643792 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-cc2bcd08-7079-44d8-b305-6d15b8c3e5c5 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:13:53.644709 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-cc2bcd08-7079-44d8-b305-6d15b8c3e5c5 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:13:53.645151 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-cc2bcd08-7079-44d8-b305-6d15b8c3e5c5 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:13:54.256320 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-cc2bcd08-7079-44d8-b305-6d15b8c3e5c5 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] 10.222.0.20 "POST /compute/v2.1/servers/0c303914-e7aa-4775-a6ae-b57f31cfe479/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.627995 Jul 01 04:13:54.256932 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 423/852] 10.222.0.20 () {60 vars in 1322 bytes} [Fri Jul 1 04:13:53 2022] POST /compute/v2.1/servers/0c303914-e7aa-4775-a6ae-b57f31cfe479/os-volume_attachments => generated 194 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 04:14:01.758459 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-b4964684-29f9-4615-8939-e00028023ca3 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8aeda75d-e37e-4444-a6b2-e084c2acea64"}} {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 04:14:01.759645 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-b4964684-29f9-4615-8939-e00028023ca3 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] [instance: 0c303914-e7aa-4775-a6ae-b57f31cfe479] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:14:01.762268 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG dbcounter [-] [118712] Writing DB stats nova_api:SELECT=57,nova_api:INSERT=3 {{(pid=118712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:14:01.767314 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-b4964684-29f9-4615-8939-e00028023ca3 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:14:01.767773 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-b4964684-29f9-4615-8939-e00028023ca3 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:14:01.769373 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-b4964684-29f9-4615-8939-e00028023ca3 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:14:01.769651 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-b4964684-29f9-4615-8939-e00028023ca3 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:14:01.847447 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.wsgi [None req-b4964684-29f9-4615-8939-e00028023ca3 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] HTTP exception thrown: Invalid volume: volume 8aeda75d-e37e-4444-a6b2-e084c2acea64 is already attached to instances: 0c303914-e7aa-4775-a6ae-b57f31cfe479 Jul 01 04:14:01.849185 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-b4964684-29f9-4615-8939-e00028023ca3 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Request method failure captured: Jul 01 04:14:01.849185 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: request: POST /compute/v2.1/servers/0c303914-e7aa-4775-a6ae-b57f31cfe479/os-volume_attachments HTTP/1.1 Jul 01 04:14:01.849185 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: Accept: application/json Jul 01 04:14:01.849185 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: Accept-Encoding: identity Jul 01 04:14:01.849185 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: Connection: close Jul 01 04:14:01.849185 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: Content-Length: 74 Jul 01 04:14:01.849185 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: Content-Type: application/json Jul 01 04:14:01.849185 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: Host: 10.222.0.20 Jul 01 04:14:01.849185 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: Openstack-System-Scope: None Jul 01 04:14:01.849185 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: User-Agent: python-urllib3/1.26.9 Jul 01 04:14:01.849185 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Auth-Token: gAAAAABivnO_2SHspn5040vH8P4vp6P_nHqsfbY2b8BaTxMU37E-Nm1nW3UiPrXBDY7TPTOcTyJxuvdXyhrWNFcAJgF991L1LL3g9HBHqdiHQSEKxKFPESilMhAE3M7664WhTBceQb5njdTfXXYCgJ_rjpGbTLpsJzn6ZaZQDIGWFCb9NOvUG5w Jul 01 04:14:01.849185 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Domain-Id: None Jul 01 04:14:01.849185 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Domain-Name: None Jul 01 04:14:01.849185 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Identity-Status: Confirmed Jul 01 04:14:01.849185 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Is-Admin-Project: True Jul 01 04:14:01.849185 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Project-Domain-Id: default Jul 01 04:14:01.849185 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Project-Domain-Name: Default Jul 01 04:14:01.849185 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Project-Id: f76a684261dd49f68a42a4e157355f37 Jul 01 04:14:01.849185 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Project-Name: tempest-AttachVolumeNegativeTest-1321993683 Jul 01 04:14:01.849185 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Role: reader,member Jul 01 04:14:01.849185 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Roles: reader,member Jul 01 04:14:01.850991 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/f76a684261dd49f68a42a4e157355f37"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_f76a684261dd49f68a42a4e157355f37", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f76a684261dd49f68a42a4e157355f37"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f76a684261dd49f68a42a4e157355f37"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}] Jul 01 04:14:01.850991 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Tenant: tempest-AttachVolumeNegativeTest-1321993683 Jul 01 04:14:01.850991 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Tenant-Id: f76a684261dd49f68a42a4e157355f37 Jul 01 04:14:01.850991 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1321993683 Jul 01 04:14:01.850991 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-User: tempest-AttachVolumeNegativeTest-1321993683-project Jul 01 04:14:01.850991 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-User-Domain-Id: default Jul 01 04:14:01.850991 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-User-Domain-Name: Default Jul 01 04:14:01.850991 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-User-Id: 4ac71714265342098d2487a701a6c364 Jul 01 04:14:01.850991 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-User-Name: tempest-AttachVolumeNegativeTest-1321993683-project Jul 01 04:14:01.850991 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: Jul 01 04:14:01.850991 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: {"volumeAttachment": {"volumeId": "8aeda75d-e37e-4444-a6b2-e084c2acea64"}} Jul 01 04:14:01.850991 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: method: > Jul 01 04:14:01.851959 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: exception: Invalid volume: volume 8aeda75d-e37e-4444-a6b2-e084c2acea64 is already attached to instances: 0c303914-e7aa-4775-a6ae-b57f31cfe479 Jul 01 04:14:01.851959 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: action_args: {'server_id': '0c303914-e7aa-4775-a6ae-b57f31cfe479', 'body': {'volumeAttachment': {'volumeId': '8aeda75d-e37e-4444-a6b2-e084c2acea64'}}} Jul 01 04:14:01.851959 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 04:14:01.851959 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 04:14:01.851959 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 01 04:14:01.851959 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 01 04:14:01.851959 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 01 04:14:01.851959 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 01 04:14:01.851959 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 01 04:14:01.851959 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 01 04:14:01.851959 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jul 01 04:14:01.851959 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 01 04:14:01.851959 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jul 01 04:14:01.851959 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 01 04:14:01.851959 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 8aeda75d-e37e-4444-a6b2-e084c2acea64 is already attached to instances: 0c303914-e7aa-4775-a6ae-b57f31cfe479 Jul 01 04:14:01.851959 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi Jul 01 04:14:01.851959 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 04:14:01.851959 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi Jul 01 04:14:01.851959 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 04:14:01.853464 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 04:14:01.853464 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 04:14:01.853464 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 04:14:01.853464 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 04:14:01.853464 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 04:14:01.853464 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 04:14:01.853464 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 01 04:14:01.853464 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 01 04:14:01.853464 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 01 04:14:01.853464 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 01 04:14:01.853464 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 01 04:14:01.853464 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 01 04:14:01.853464 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 01 04:14:01.853464 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 01 04:14:01.853464 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 8aeda75d-e37e-4444-a6b2-e084c2acea64 is already attached to instances: 0c303914-e7aa-4775-a6ae-b57f31cfe479 Jul 01 04:14:01.853464 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi Jul 01 04:14:01.853464 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 04:14:01.853464 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi Jul 01 04:14:01.853464 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 04:14:01.853464 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 04:14:01.855077 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 04:14:01.855077 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 04:14:01.855077 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 04:14:01.855077 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 8aeda75d-e37e-4444-a6b2-e084c2acea64 is already attached to instances: 0c303914-e7aa-4775-a6ae-b57f31cfe479 Jul 01 04:14:01.855077 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi Jul 01 04:14:01.855077 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-b4964684-29f9-4615-8939-e00028023ca3 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Returning 400 to user: Invalid volume: volume 8aeda75d-e37e-4444-a6b2-e084c2acea64 is already attached to instances: 0c303914-e7aa-4775-a6ae-b57f31cfe479 {{(pid=118712) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 04:14:01.855077 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-b4964684-29f9-4615-8939-e00028023ca3 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] 10.222.0.20 "POST /compute/v2.1/servers/0c303914-e7aa-4775-a6ae-b57f31cfe479/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.096542 Jul 01 04:14:01.855077 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 430/853] 10.222.0.20 () {60 vars in 1322 bytes} [Fri Jul 1 04:14:01 2022] POST /compute/v2.1/servers/0c303914-e7aa-4775-a6ae-b57f31cfe479/os-volume_attachments => generated 174 bytes in 98 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 01 04:14:01.911848 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-a4965ee6-b793-41bb-8a69-737f4e08e602 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:14:01.912369 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-a4965ee6-b793-41bb-8a69-737f4e08e602 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] [instance: 0c303914-e7aa-4775-a6ae-b57f31cfe479] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:14:01.914888 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG dbcounter [-] [118711] Writing DB stats nova_api:SELECT=52 {{(pid=118711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:14:01.919825 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-a4965ee6-b793-41bb-8a69-737f4e08e602 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:14:01.920273 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-a4965ee6-b793-41bb-8a69-737f4e08e602 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:14:01.921033 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-a4965ee6-b793-41bb-8a69-737f4e08e602 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:14:01.921469 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-a4965ee6-b793-41bb-8a69-737f4e08e602 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:14:02.000454 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.objects.instance [None req-a4965ee6-b793-41bb-8a69-737f4e08e602 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lazy-loading 'services' on Instance uuid 0c303914-e7aa-4775-a6ae-b57f31cfe479 {{(pid=118711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 04:14:02.182587 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-a4965ee6-b793-41bb-8a69-737f4e08e602 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] 10.222.0.20 "DELETE /compute/v2.1/servers/0c303914-e7aa-4775-a6ae-b57f31cfe479/os-volume_attachments/8aeda75d-e37e-4444-a6b2-e084c2acea64" status: 202 len: 0 microversion: 2.1 time: 0.274777 Jul 01 04:14:02.183109 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 424/854] 10.222.0.20 () {58 vars in 1415 bytes} [Fri Jul 1 04:14:01 2022] DELETE /compute/v2.1/servers/0c303914-e7aa-4775-a6ae-b57f31cfe479/os-volume_attachments/8aeda75d-e37e-4444-a6b2-e084c2acea64 => generated 0 bytes in 276 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 04:14:02.192276 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-d3eb306a-6250-49f0-9595-45c1806dd14e tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:14:02.193541 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-d3eb306a-6250-49f0-9595-45c1806dd14e tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] [instance: 0c303914-e7aa-4775-a6ae-b57f31cfe479] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:14:02.199648 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-d3eb306a-6250-49f0-9595-45c1806dd14e tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:14:02.200112 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-d3eb306a-6250-49f0-9595-45c1806dd14e tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:14:02.200890 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-d3eb306a-6250-49f0-9595-45c1806dd14e tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:14:02.201334 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-d3eb306a-6250-49f0-9595-45c1806dd14e tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:14:02.231481 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-d3eb306a-6250-49f0-9595-45c1806dd14e tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] 10.222.0.20 "GET /compute/v2.1/servers/0c303914-e7aa-4775-a6ae-b57f31cfe479/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043909 Jul 01 04:14:02.232069 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 431/855] 10.222.0.20 () {58 vars in 1301 bytes} [Fri Jul 1 04:14:02 2022] GET /compute/v2.1/servers/0c303914-e7aa-4775-a6ae-b57f31cfe479/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 01 04:14:03.244426 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-84953084-cd50-4e75-8ebe-b156d9e0d590 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:14:03.245512 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-84953084-cd50-4e75-8ebe-b156d9e0d590 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] [instance: 0c303914-e7aa-4775-a6ae-b57f31cfe479] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:14:03.253106 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-84953084-cd50-4e75-8ebe-b156d9e0d590 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:14:03.253553 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-84953084-cd50-4e75-8ebe-b156d9e0d590 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:14:03.254968 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-84953084-cd50-4e75-8ebe-b156d9e0d590 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:14:03.255389 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-84953084-cd50-4e75-8ebe-b156d9e0d590 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:14:03.285197 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-84953084-cd50-4e75-8ebe-b156d9e0d590 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] 10.222.0.20 "GET /compute/v2.1/servers/0c303914-e7aa-4775-a6ae-b57f31cfe479/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045689 Jul 01 04:14:03.285806 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 425/856] 10.222.0.20 () {58 vars in 1301 bytes} [Fri Jul 1 04:14:03 2022] GET /compute/v2.1/servers/0c303914-e7aa-4775-a6ae-b57f31cfe479/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 01 04:14:03.346363 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-59c89862-94ce-4473-9f52-78f1a7a221cc tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:14:03.346964 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-59c89862-94ce-4473-9f52-78f1a7a221cc tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] [instance: 0c303914-e7aa-4775-a6ae-b57f31cfe479] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:14:03.354074 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-59c89862-94ce-4473-9f52-78f1a7a221cc tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:14:03.356411 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-59c89862-94ce-4473-9f52-78f1a7a221cc tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:14:03.356411 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-59c89862-94ce-4473-9f52-78f1a7a221cc tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:14:03.356411 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-59c89862-94ce-4473-9f52-78f1a7a221cc tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:14:03.384435 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-59c89862-94ce-4473-9f52-78f1a7a221cc tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] [instance: 0c303914-e7aa-4775-a6ae-b57f31cfe479] Going to try to terminate instance {{(pid=118712) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 01 04:14:03.674289 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-59c89862-94ce-4473-9f52-78f1a7a221cc tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] 10.222.0.20 "DELETE /compute/v2.1/servers/0c303914-e7aa-4775-a6ae-b57f31cfe479" status: 204 len: 0 microversion: 2.1 time: 0.331694 Jul 01 04:14:03.674925 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 432/857] 10.222.0.20 () {58 vars in 1238 bytes} [Fri Jul 1 04:14:03 2022] DELETE /compute/v2.1/servers/0c303914-e7aa-4775-a6ae-b57f31cfe479 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 01 04:14:03.683857 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-013823fb-9a46-4619-b1d9-3a93a6c85a0b tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:14:03.689910 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-013823fb-9a46-4619-b1d9-3a93a6c85a0b tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] [instance: 0c303914-e7aa-4775-a6ae-b57f31cfe479] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:14:03.690837 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-013823fb-9a46-4619-b1d9-3a93a6c85a0b tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:14:03.691992 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-013823fb-9a46-4619-b1d9-3a93a6c85a0b tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:14:03.693250 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-013823fb-9a46-4619-b1d9-3a93a6c85a0b tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:14:03.693875 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-013823fb-9a46-4619-b1d9-3a93a6c85a0b tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:14:03.829061 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-013823fb-9a46-4619-b1d9-3a93a6c85a0b tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac71714265342098d2487a701a6c364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f76a684261dd49f68a42a4e157355f37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:14:03.836436 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-013823fb-9a46-4619-b1d9-3a93a6c85a0b tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] 10.222.0.20 "GET /compute/v2.1/servers/0c303914-e7aa-4775-a6ae-b57f31cfe479" status: 200 len: 1681 microversion: 2.1 time: 0.156521 Jul 01 04:14:03.836989 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 426/858] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:14:03 2022] GET /compute/v2.1/servers/0c303914-e7aa-4775-a6ae-b57f31cfe479 => generated 1681 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:14:04.857444 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-1d88818e-25ac-4d0d-8631-f79459a6f49e tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:14:04.858269 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-1d88818e-25ac-4d0d-8631-f79459a6f49e tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] [instance: 0c303914-e7aa-4775-a6ae-b57f31cfe479] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:14:04.868059 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-1d88818e-25ac-4d0d-8631-f79459a6f49e tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:14:04.869147 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-1d88818e-25ac-4d0d-8631-f79459a6f49e tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:14:04.869939 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-1d88818e-25ac-4d0d-8631-f79459a6f49e tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:14:04.870379 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-1d88818e-25ac-4d0d-8631-f79459a6f49e tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:14:05.167456 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-1d88818e-25ac-4d0d-8631-f79459a6f49e tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac71714265342098d2487a701a6c364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f76a684261dd49f68a42a4e157355f37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:14:05.174970 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-1d88818e-25ac-4d0d-8631-f79459a6f49e tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] 10.222.0.20 "GET /compute/v2.1/servers/0c303914-e7aa-4775-a6ae-b57f31cfe479" status: 200 len: 1681 microversion: 2.1 time: 0.324778 Jul 01 04:14:05.175556 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 433/859] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:14:04 2022] GET /compute/v2.1/servers/0c303914-e7aa-4775-a6ae-b57f31cfe479 => generated 1681 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:14:06.193104 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-8b74968a-602e-4eb0-8bb5-81cc220a19dc tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:14:06.193696 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-8b74968a-602e-4eb0-8bb5-81cc220a19dc tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] [instance: 0c303914-e7aa-4775-a6ae-b57f31cfe479] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:14:06.200113 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-8b74968a-602e-4eb0-8bb5-81cc220a19dc tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:14:06.200558 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-8b74968a-602e-4eb0-8bb5-81cc220a19dc tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:14:06.201341 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-8b74968a-602e-4eb0-8bb5-81cc220a19dc tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:14:06.202258 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-8b74968a-602e-4eb0-8bb5-81cc220a19dc tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:14:06.276659 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-8b74968a-602e-4eb0-8bb5-81cc220a19dc tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac71714265342098d2487a701a6c364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f76a684261dd49f68a42a4e157355f37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:14:06.284661 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-8b74968a-602e-4eb0-8bb5-81cc220a19dc tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] 10.222.0.20 "GET /compute/v2.1/servers/0c303914-e7aa-4775-a6ae-b57f31cfe479" status: 200 len: 1613 microversion: 2.1 time: 0.096385 Jul 01 04:14:06.285339 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 427/860] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:14:06 2022] GET /compute/v2.1/servers/0c303914-e7aa-4775-a6ae-b57f31cfe479 => generated 1613 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:14:06.362634 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [req-8f42b09d-5ad5-4763-8567-756de3a812c6 req-3f0f6524-2665-4888-9fa7-f6753a3c5484 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c303914-e7aa-4775-a6ae-b57f31cfe479", "name": "network-vif-deleted", "tag": "4550d2de-2810-47c5-9f6d-1b915cc006c5"}]} {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 04:14:06.373436 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [req-8f42b09d-5ad5-4763-8567-756de3a812c6 req-3f0f6524-2665-4888-9fa7-f6753a3c5484 service nova] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:14:06.373889 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [req-8f42b09d-5ad5-4763-8567-756de3a812c6 req-3f0f6524-2665-4888-9fa7-f6753a3c5484 service nova] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:14:06.387899 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.compute.server_external_events [req-8f42b09d-5ad5-4763-8567-756de3a812c6 req-3f0f6524-2665-4888-9fa7-f6753a3c5484 service nova] Creating event network-vif-deleted:4550d2de-2810-47c5-9f6d-1b915cc006c5 for instance 0c303914-e7aa-4775-a6ae-b57f31cfe479 on hv-cinder-84684 Jul 01 04:14:06.392926 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [req-8f42b09d-5ad5-4763-8567-756de3a812c6 req-3f0f6524-2665-4888-9fa7-f6753a3c5484 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033906 Jul 01 04:14:06.394169 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 434/861] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Jul 1 04:14:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 04:14:07.302916 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-09e1bf7f-0414-49f3-a2da-4a4bd69da787 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:14:07.308595 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-09e1bf7f-0414-49f3-a2da-4a4bd69da787 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] [instance: 0c303914-e7aa-4775-a6ae-b57f31cfe479] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:14:07.311021 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-09e1bf7f-0414-49f3-a2da-4a4bd69da787 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:14:07.311491 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-09e1bf7f-0414-49f3-a2da-4a4bd69da787 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:14:07.312318 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-09e1bf7f-0414-49f3-a2da-4a4bd69da787 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:14:07.312779 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-09e1bf7f-0414-49f3-a2da-4a4bd69da787 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:14:07.345909 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-09e1bf7f-0414-49f3-a2da-4a4bd69da787 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:14:07.346418 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-09e1bf7f-0414-49f3-a2da-4a4bd69da787 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:14:07.346810 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.objects.instance [None req-09e1bf7f-0414-49f3-a2da-4a4bd69da787 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lazy-loading 'fault' on Instance uuid 0c303914-e7aa-4775-a6ae-b57f31cfe479 {{(pid=118711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 04:14:07.393136 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-09e1bf7f-0414-49f3-a2da-4a4bd69da787 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac71714265342098d2487a701a6c364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f76a684261dd49f68a42a4e157355f37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:14:07.403292 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-09e1bf7f-0414-49f3-a2da-4a4bd69da787 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] 10.222.0.20 "GET /compute/v2.1/servers/0c303914-e7aa-4775-a6ae-b57f31cfe479" status: 200 len: 1331 microversion: 2.1 time: 0.102761 Jul 01 04:14:07.403292 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 428/862] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:14:07 2022] GET /compute/v2.1/servers/0c303914-e7aa-4775-a6ae-b57f31cfe479 => generated 1331 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:14:08.419537 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-86f3aee5-0f6d-4a39-bc59-0e4bc2fff0c2 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:14:08.420253 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-86f3aee5-0f6d-4a39-bc59-0e4bc2fff0c2 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] [instance: 0c303914-e7aa-4775-a6ae-b57f31cfe479] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:14:08.426501 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-86f3aee5-0f6d-4a39-bc59-0e4bc2fff0c2 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:14:08.426960 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-86f3aee5-0f6d-4a39-bc59-0e4bc2fff0c2 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:14:08.427761 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-86f3aee5-0f6d-4a39-bc59-0e4bc2fff0c2 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:14:08.428206 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-86f3aee5-0f6d-4a39-bc59-0e4bc2fff0c2 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:14:08.441258 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.wsgi [None req-86f3aee5-0f6d-4a39-bc59-0e4bc2fff0c2 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] HTTP exception thrown: Instance 0c303914-e7aa-4775-a6ae-b57f31cfe479 could not be found. Jul 01 04:14:08.443778 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-86f3aee5-0f6d-4a39-bc59-0e4bc2fff0c2 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Request method failure captured: Jul 01 04:14:08.443778 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: request: GET /compute/v2.1/servers/0c303914-e7aa-4775-a6ae-b57f31cfe479 HTTP/1.1 Jul 01 04:14:08.443778 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: Accept: application/json Jul 01 04:14:08.443778 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: Accept-Encoding: identity Jul 01 04:14:08.443778 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: Connection: close Jul 01 04:14:08.443778 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: Content-Length: 0 Jul 01 04:14:08.443778 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: Content-Type: application/json Jul 01 04:14:08.443778 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: Host: 10.222.0.20 Jul 01 04:14:08.443778 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: Openstack-System-Scope: None Jul 01 04:14:08.443778 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: User-Agent: python-urllib3/1.26.9 Jul 01 04:14:08.443778 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Auth-Token: gAAAAABivnO_2SHspn5040vH8P4vp6P_nHqsfbY2b8BaTxMU37E-Nm1nW3UiPrXBDY7TPTOcTyJxuvdXyhrWNFcAJgF991L1LL3g9HBHqdiHQSEKxKFPESilMhAE3M7664WhTBceQb5njdTfXXYCgJ_rjpGbTLpsJzn6ZaZQDIGWFCb9NOvUG5w Jul 01 04:14:08.443778 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Domain-Id: None Jul 01 04:14:08.443778 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Domain-Name: None Jul 01 04:14:08.443778 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Identity-Status: Confirmed Jul 01 04:14:08.443778 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Is-Admin-Project: True Jul 01 04:14:08.443778 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Project-Domain-Id: default Jul 01 04:14:08.443778 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Project-Domain-Name: Default Jul 01 04:14:08.443778 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Project-Id: f76a684261dd49f68a42a4e157355f37 Jul 01 04:14:08.443778 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Project-Name: tempest-AttachVolumeNegativeTest-1321993683 Jul 01 04:14:08.443778 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Role: reader,member Jul 01 04:14:08.443778 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Roles: reader,member Jul 01 04:14:08.445461 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/f76a684261dd49f68a42a4e157355f37"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_f76a684261dd49f68a42a4e157355f37", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f76a684261dd49f68a42a4e157355f37"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f76a684261dd49f68a42a4e157355f37"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}] Jul 01 04:14:08.445461 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Tenant: tempest-AttachVolumeNegativeTest-1321993683 Jul 01 04:14:08.445461 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Tenant-Id: f76a684261dd49f68a42a4e157355f37 Jul 01 04:14:08.445461 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1321993683 Jul 01 04:14:08.445461 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-User: tempest-AttachVolumeNegativeTest-1321993683-project Jul 01 04:14:08.445461 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-User-Domain-Id: default Jul 01 04:14:08.445461 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-User-Domain-Name: Default Jul 01 04:14:08.445461 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-User-Id: 4ac71714265342098d2487a701a6c364 Jul 01 04:14:08.445461 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-User-Name: tempest-AttachVolumeNegativeTest-1321993683-project Jul 01 04:14:08.445461 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: method: > Jul 01 04:14:08.445461 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: exception: Instance 0c303914-e7aa-4775-a6ae-b57f31cfe479 could not be found. Jul 01 04:14:08.445461 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: action_args: {'id': '0c303914-e7aa-4775-a6ae-b57f31cfe479'} Jul 01 04:14:08.446305 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 04:14:08.446305 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 04:14:08.446305 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 04:14:08.446305 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 04:14:08.446305 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 04:14:08.446305 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 04:14:08.446305 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 04:14:08.446305 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 04:14:08.446305 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 04:14:08.446305 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 04:14:08.446305 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0c303914-e7aa-4775-a6ae-b57f31cfe479 could not be found. Jul 01 04:14:08.446305 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi Jul 01 04:14:08.446305 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 04:14:08.446305 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi Jul 01 04:14:08.446305 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 04:14:08.446305 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 04:14:08.446305 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 04:14:08.446305 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 04:14:08.446305 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 04:14:08.446305 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 04:14:08.447839 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 04:14:08.447839 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 04:14:08.447839 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 04:14:08.447839 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 04:14:08.447839 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 04:14:08.447839 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 04:14:08.447839 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 04:14:08.447839 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0c303914-e7aa-4775-a6ae-b57f31cfe479 could not be found. Jul 01 04:14:08.447839 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi Jul 01 04:14:08.447839 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 04:14:08.447839 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi Jul 01 04:14:08.447839 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 04:14:08.447839 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 04:14:08.447839 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 04:14:08.447839 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 04:14:08.447839 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 04:14:08.447839 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0c303914-e7aa-4775-a6ae-b57f31cfe479 could not be found. Jul 01 04:14:08.447839 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi Jul 01 04:14:08.449159 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-86f3aee5-0f6d-4a39-bc59-0e4bc2fff0c2 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Returning 404 to user: Instance 0c303914-e7aa-4775-a6ae-b57f31cfe479 could not be found. {{(pid=118712) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 04:14:08.449159 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-86f3aee5-0f6d-4a39-bc59-0e4bc2fff0c2 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] 10.222.0.20 "GET /compute/v2.1/servers/0c303914-e7aa-4775-a6ae-b57f31cfe479" status: 404 len: 111 microversion: 2.1 time: 0.030659 Jul 01 04:14:08.449159 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 435/863] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:14:08 2022] GET /compute/v2.1/servers/0c303914-e7aa-4775-a6ae-b57f31cfe479 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 04:14:08.455041 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-f961d749-1719-4420-b274-54f730381f6b tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Calling method '.version_select at 0x7f99a0716280>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:14:08.539468 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-f961d749-1719-4420-b274-54f730381f6b tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1221054957" status: 202 len: 0 microversion: 2.1 time: 0.088188 Jul 01 04:14:08.540058 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 429/864] 10.222.0.20 () {58 vars in 1220 bytes} [Fri Jul 1 04:14:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1221054957 => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 04:14:09.368315 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-480a5385-ea6c-49b9-8503-d9922b22b081 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Action: 'create', calling method: .version_select at 0x7f99a06fe670>, body: {"keypair": {"name": "tempest-keypair-1858610472", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ95tmjZxX0g6Aht4HT+bbbtcnFaOJC6ZZ4ozZpFv3vcGYjMJehfBqXOoELe78uT6w9syEc9oUbYKfIRyPP2WLekOq3gie0Vz8++fNwHYONpWO/zXDhdFEKMdtg5j4ywsQ=="}} {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 04:14:09.382179 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.quota [None req-480a5385-ea6c-49b9-8503-d9922b22b081 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Getting quotas for project f76a684261dd49f68a42a4e157355f37. Resources: {'key_pairs'} {{(pid=118712) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 04:14:09.385941 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.quota [None req-480a5385-ea6c-49b9-8503-d9922b22b081 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Getting quotas for user 4ac71714265342098d2487a701a6c364 and project f76a684261dd49f68a42a4e157355f37. Resources: {'key_pairs'} {{(pid=118712) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 04:14:09.476322 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-480a5385-ea6c-49b9-8503-d9922b22b081 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.112669 Jul 01 04:14:09.477025 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 436/865] 10.222.0.20 () {60 vars in 1158 bytes} [Fri Jul 1 04:14:09 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 04:14:11.918230 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-3d84fbe0-2431-48bb-829c-077aac7b187a tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1335418927", "imageRef": "66f9f4ba-339c-4967-8857-d65299a66629", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "72a30e53-10ad-40de-bc68-366d09fc48e5"}], "security_groups": [{"name": "tempest-securitygroup--457202611"}], "key_name": "tempest-keypair-1858610472", "user_data": "}} {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 04:14:12.024751 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.network.neutron [None req-3d84fbe0-2431-48bb-829c-077aac7b187a tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] validate_networks() for [('72a30e53-10ad-40de-bc68-366d09fc48e5', None, None, None, None, None)] {{(pid=118711) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 01 04:14:12.390854 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.virt.hardware [None req-3d84fbe0-2431-48bb-829c-077aac7b187a tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Flavor limits 0:0:0 {{(pid=118711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 01 04:14:12.391381 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.virt.hardware [None req-3d84fbe0-2431-48bb-829c-077aac7b187a tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Image limits 0:0:0 {{(pid=118711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 01 04:14:12.391855 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.virt.hardware [None req-3d84fbe0-2431-48bb-829c-077aac7b187a tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Flavor pref 0:0:0 {{(pid=118711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 01 04:14:12.392259 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.virt.hardware [None req-3d84fbe0-2431-48bb-829c-077aac7b187a tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Image pref 0:0:0 {{(pid=118711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 01 04:14:12.392671 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.virt.hardware [None req-3d84fbe0-2431-48bb-829c-077aac7b187a tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 01 04:14:12.401903 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-3d84fbe0-2431-48bb-829c-077aac7b187a tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:14:12.402350 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-3d84fbe0-2431-48bb-829c-077aac7b187a tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:14:12.403147 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-3d84fbe0-2431-48bb-829c-077aac7b187a tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:14:12.403618 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-3d84fbe0-2431-48bb-829c-077aac7b187a tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:14:12.421285 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.quota [None req-3d84fbe0-2431-48bb-829c-077aac7b187a tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Getting quotas for project f76a684261dd49f68a42a4e157355f37. Resources: {'ram', 'cores', 'instances'} {{(pid=118711) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 04:14:12.425231 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.quota [None req-3d84fbe0-2431-48bb-829c-077aac7b187a tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Getting quotas for user 4ac71714265342098d2487a701a6c364 and project f76a684261dd49f68a42a4e157355f37. Resources: {'ram', 'cores', 'instances'} {{(pid=118711) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 04:14:12.436772 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-3d84fbe0-2431-48bb-829c-077aac7b187a tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Going to run 1 instances... {{(pid=118711) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 01 04:14:12.439075 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-3d84fbe0-2431-48bb-829c-077aac7b187a tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] [instance: c2b0a742-21ea-4db3-bbe6-f261c65d7db6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='66f9f4ba-339c-4967-8857-d65299a66629',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118711) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 01 04:14:12.579874 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-3d84fbe0-2431-48bb-829c-077aac7b187a tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.665810 Jul 01 04:14:12.580532 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 430/866] 10.222.0.20 () {60 vars in 1146 bytes} [Fri Jul 1 04:14:11 2022] POST /compute/v2.1/servers => generated 401 bytes in 667 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 01 04:14:12.592103 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-7b05bb15-a576-4f31-b233-e27e838ebbe1 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:14:12.592877 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-7b05bb15-a576-4f31-b233-e27e838ebbe1 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] [instance: c2b0a742-21ea-4db3-bbe6-f261c65d7db6] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:14:12.657099 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-7b05bb15-a576-4f31-b233-e27e838ebbe1 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac71714265342098d2487a701a6c364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f76a684261dd49f68a42a4e157355f37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:14:12.664598 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-7b05bb15-a576-4f31-b233-e27e838ebbe1 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] 10.222.0.20 "GET /compute/v2.1/servers/c2b0a742-21ea-4db3-bbe6-f261c65d7db6" status: 200 len: 1242 microversion: 2.1 time: 0.077250 Jul 01 04:14:12.665145 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 437/867] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:14:12 2022] GET /compute/v2.1/servers/c2b0a742-21ea-4db3-bbe6-f261c65d7db6 => generated 1242 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:14:13.682583 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-4147a457-ba99-4669-ba0b-235cf184a096 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:14:13.683278 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-4147a457-ba99-4669-ba0b-235cf184a096 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] [instance: c2b0a742-21ea-4db3-bbe6-f261c65d7db6] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:14:13.689479 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-4147a457-ba99-4669-ba0b-235cf184a096 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:14:13.689936 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-4147a457-ba99-4669-ba0b-235cf184a096 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:14:13.690713 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-4147a457-ba99-4669-ba0b-235cf184a096 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:14:13.691157 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-4147a457-ba99-4669-ba0b-235cf184a096 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:14:13.756021 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-4147a457-ba99-4669-ba0b-235cf184a096 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac71714265342098d2487a701a6c364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f76a684261dd49f68a42a4e157355f37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:14:13.763506 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-4147a457-ba99-4669-ba0b-235cf184a096 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] 10.222.0.20 "GET /compute/v2.1/servers/c2b0a742-21ea-4db3-bbe6-f261c65d7db6" status: 200 len: 1246 microversion: 2.1 time: 0.085206 Jul 01 04:14:13.764072 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 431/868] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:14:13 2022] GET /compute/v2.1/servers/c2b0a742-21ea-4db3-bbe6-f261c65d7db6 => generated 1246 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:14:14.781123 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-d5bd98ca-2e89-4a28-b83d-609dd26fcb28 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:14:14.781953 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-d5bd98ca-2e89-4a28-b83d-609dd26fcb28 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] [instance: c2b0a742-21ea-4db3-bbe6-f261c65d7db6] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:14:14.790291 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-d5bd98ca-2e89-4a28-b83d-609dd26fcb28 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:14:14.790754 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-d5bd98ca-2e89-4a28-b83d-609dd26fcb28 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:14:14.791585 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-d5bd98ca-2e89-4a28-b83d-609dd26fcb28 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:14:14.792115 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-d5bd98ca-2e89-4a28-b83d-609dd26fcb28 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:14:14.865510 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-d5bd98ca-2e89-4a28-b83d-609dd26fcb28 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac71714265342098d2487a701a6c364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f76a684261dd49f68a42a4e157355f37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:14:14.875372 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-d5bd98ca-2e89-4a28-b83d-609dd26fcb28 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] 10.222.0.20 "GET /compute/v2.1/servers/c2b0a742-21ea-4db3-bbe6-f261c65d7db6" status: 200 len: 1302 microversion: 2.1 time: 0.098721 Jul 01 04:14:14.876172 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 438/869] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:14:14 2022] GET /compute/v2.1/servers/c2b0a742-21ea-4db3-bbe6-f261c65d7db6 => generated 1302 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:14:15.892671 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-202d92b8-89c0-40d6-ac57-8950f00a846d tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:14:15.893273 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-202d92b8-89c0-40d6-ac57-8950f00a846d tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] [instance: c2b0a742-21ea-4db3-bbe6-f261c65d7db6] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:14:15.900181 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-202d92b8-89c0-40d6-ac57-8950f00a846d tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:14:15.900800 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-202d92b8-89c0-40d6-ac57-8950f00a846d tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:14:15.901484 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-202d92b8-89c0-40d6-ac57-8950f00a846d tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:14:15.901921 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-202d92b8-89c0-40d6-ac57-8950f00a846d tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:14:15.905946 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG dbcounter [-] [118711] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=118711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:14:16.099350 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-202d92b8-89c0-40d6-ac57-8950f00a846d tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac71714265342098d2487a701a6c364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f76a684261dd49f68a42a4e157355f37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:14:16.106823 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-202d92b8-89c0-40d6-ac57-8950f00a846d tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] 10.222.0.20 "GET /compute/v2.1/servers/c2b0a742-21ea-4db3-bbe6-f261c65d7db6" status: 200 len: 1367 microversion: 2.1 time: 0.218100 Jul 01 04:14:16.107423 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 432/870] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:14:15 2022] GET /compute/v2.1/servers/c2b0a742-21ea-4db3-bbe6-f261c65d7db6 => generated 1367 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:14:16.848251 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [req-7c1c05b1-c18e-4ab2-80d7-347408bc28b5 req-5e55604e-c48a-4ad0-af82-87c9d85a0031 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c2b0a742-21ea-4db3-bbe6-f261c65d7db6", "tag": "e85356b9-8a4c-49b0-95bc-3d8ba8e63319"}]} {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 04:14:16.856530 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [req-7c1c05b1-c18e-4ab2-80d7-347408bc28b5 req-5e55604e-c48a-4ad0-af82-87c9d85a0031 service nova] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:14:16.857023 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [req-7c1c05b1-c18e-4ab2-80d7-347408bc28b5 req-5e55604e-c48a-4ad0-af82-87c9d85a0031 service nova] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:14:16.861569 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG dbcounter [-] [118712] Writing DB stats nova_cell1:SELECT=72,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:14:16.869408 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.compute.server_external_events [req-7c1c05b1-c18e-4ab2-80d7-347408bc28b5 req-5e55604e-c48a-4ad0-af82-87c9d85a0031 service nova] Creating event network-changed:e85356b9-8a4c-49b0-95bc-3d8ba8e63319 for instance c2b0a742-21ea-4db3-bbe6-f261c65d7db6 on hv-cinder-84684 Jul 01 04:14:16.874963 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [req-7c1c05b1-c18e-4ab2-80d7-347408bc28b5 req-5e55604e-c48a-4ad0-af82-87c9d85a0031 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030807 Jul 01 04:14:16.875650 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 439/871] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Jul 1 04:14:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 04:14:17.125161 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-22584578-e4d0-4069-81a4-dec52d5e4f5a tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:14:17.125716 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-22584578-e4d0-4069-81a4-dec52d5e4f5a tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] [instance: c2b0a742-21ea-4db3-bbe6-f261c65d7db6] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:14:17.133046 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-22584578-e4d0-4069-81a4-dec52d5e4f5a tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:14:17.133505 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-22584578-e4d0-4069-81a4-dec52d5e4f5a tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:14:17.134301 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-22584578-e4d0-4069-81a4-dec52d5e4f5a tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:14:17.134939 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-22584578-e4d0-4069-81a4-dec52d5e4f5a tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:14:17.370648 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-22584578-e4d0-4069-81a4-dec52d5e4f5a tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac71714265342098d2487a701a6c364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f76a684261dd49f68a42a4e157355f37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:14:17.379269 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-22584578-e4d0-4069-81a4-dec52d5e4f5a tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] 10.222.0.20 "GET /compute/v2.1/servers/c2b0a742-21ea-4db3-bbe6-f261c65d7db6" status: 200 len: 1367 microversion: 2.1 time: 0.257975 Jul 01 04:14:17.380094 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 433/872] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:14:17 2022] GET /compute/v2.1/servers/c2b0a742-21ea-4db3-bbe6-f261c65d7db6 => generated 1367 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:14:18.398832 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-032fad99-6f13-4ced-8398-d8a4d21da680 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:14:18.399588 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-032fad99-6f13-4ced-8398-d8a4d21da680 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] [instance: c2b0a742-21ea-4db3-bbe6-f261c65d7db6] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:14:18.406213 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-032fad99-6f13-4ced-8398-d8a4d21da680 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:14:18.406665 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-032fad99-6f13-4ced-8398-d8a4d21da680 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:14:18.407487 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-032fad99-6f13-4ced-8398-d8a4d21da680 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:14:18.407933 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-032fad99-6f13-4ced-8398-d8a4d21da680 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:14:18.539597 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-032fad99-6f13-4ced-8398-d8a4d21da680 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac71714265342098d2487a701a6c364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f76a684261dd49f68a42a4e157355f37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:14:18.547363 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-032fad99-6f13-4ced-8398-d8a4d21da680 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] 10.222.0.20 "GET /compute/v2.1/servers/c2b0a742-21ea-4db3-bbe6-f261c65d7db6" status: 200 len: 1367 microversion: 2.1 time: 0.154158 Jul 01 04:14:18.547963 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 440/873] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:14:18 2022] GET /compute/v2.1/servers/c2b0a742-21ea-4db3-bbe6-f261c65d7db6 => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:14:19.564761 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-6f8dbf45-64ab-4b32-a490-cbd602726338 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:14:19.565360 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-6f8dbf45-64ab-4b32-a490-cbd602726338 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] [instance: c2b0a742-21ea-4db3-bbe6-f261c65d7db6] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:14:19.572725 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-6f8dbf45-64ab-4b32-a490-cbd602726338 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:14:19.573170 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-6f8dbf45-64ab-4b32-a490-cbd602726338 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:14:19.573939 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-6f8dbf45-64ab-4b32-a490-cbd602726338 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:14:19.574376 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-6f8dbf45-64ab-4b32-a490-cbd602726338 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:14:19.715610 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-6f8dbf45-64ab-4b32-a490-cbd602726338 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac71714265342098d2487a701a6c364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f76a684261dd49f68a42a4e157355f37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:14:19.723240 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-6f8dbf45-64ab-4b32-a490-cbd602726338 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] 10.222.0.20 "GET /compute/v2.1/servers/c2b0a742-21ea-4db3-bbe6-f261c65d7db6" status: 200 len: 1367 microversion: 2.1 time: 0.162332 Jul 01 04:14:19.723831 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 434/874] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:14:19 2022] GET /compute/v2.1/servers/c2b0a742-21ea-4db3-bbe6-f261c65d7db6 => generated 1367 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:14:20.739827 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-437e2a95-5f16-40b6-905f-d09a291ad1ad tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:14:20.740474 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-437e2a95-5f16-40b6-905f-d09a291ad1ad tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] [instance: c2b0a742-21ea-4db3-bbe6-f261c65d7db6] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:14:20.747559 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-437e2a95-5f16-40b6-905f-d09a291ad1ad tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:14:20.748022 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-437e2a95-5f16-40b6-905f-d09a291ad1ad tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:14:20.748859 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-437e2a95-5f16-40b6-905f-d09a291ad1ad tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:14:20.749850 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-437e2a95-5f16-40b6-905f-d09a291ad1ad tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:14:20.756854 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-0bf600ec-5fc3-4cd2-9f24-664b82178c95 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:14:20.757413 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-0bf600ec-5fc3-4cd2-9f24-664b82178c95 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] [instance: 2e5d1edc-dbae-41dd-ab34-aa954b62f390] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:14:20.763967 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-0bf600ec-5fc3-4cd2-9f24-664b82178c95 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:14:20.764423 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-0bf600ec-5fc3-4cd2-9f24-664b82178c95 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:14:20.765791 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-0bf600ec-5fc3-4cd2-9f24-664b82178c95 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:14:20.765791 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-0bf600ec-5fc3-4cd2-9f24-664b82178c95 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:14:20.856467 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.objects.instance [None req-0bf600ec-5fc3-4cd2-9f24-664b82178c95 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lazy-loading 'services' on Instance uuid 2e5d1edc-dbae-41dd-ab34-aa954b62f390 {{(pid=118711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 04:14:20.896626 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-437e2a95-5f16-40b6-905f-d09a291ad1ad tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac71714265342098d2487a701a6c364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f76a684261dd49f68a42a4e157355f37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:14:20.905251 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-437e2a95-5f16-40b6-905f-d09a291ad1ad tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] 10.222.0.20 "GET /compute/v2.1/servers/c2b0a742-21ea-4db3-bbe6-f261c65d7db6" status: 200 len: 1367 microversion: 2.1 time: 0.169170 Jul 01 04:14:20.905982 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 441/875] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:14:20 2022] GET /compute/v2.1/servers/c2b0a742-21ea-4db3-bbe6-f261c65d7db6 => generated 1367 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:14:21.079533 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-0bf600ec-5fc3-4cd2-9f24-664b82178c95 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] 10.222.0.20 "DELETE /compute/v2.1/servers/2e5d1edc-dbae-41dd-ab34-aa954b62f390/os-volume_attachments/6d88b683-ef7f-4bd8-a8d6-51f98efb2056" status: 202 len: 0 microversion: 2.1 time: 0.326337 Jul 01 04:14:21.080137 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 435/876] 10.222.0.20 () {58 vars in 1415 bytes} [Fri Jul 1 04:14:20 2022] DELETE /compute/v2.1/servers/2e5d1edc-dbae-41dd-ab34-aa954b62f390/os-volume_attachments/6d88b683-ef7f-4bd8-a8d6-51f98efb2056 => generated 0 bytes in 328 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 04:14:21.923042 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-de869bcf-eebe-4435-a8be-285afe1932d2 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:14:21.923682 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-de869bcf-eebe-4435-a8be-285afe1932d2 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] [instance: c2b0a742-21ea-4db3-bbe6-f261c65d7db6] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:14:21.930806 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-de869bcf-eebe-4435-a8be-285afe1932d2 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:14:21.931275 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-de869bcf-eebe-4435-a8be-285afe1932d2 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:14:21.932046 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-de869bcf-eebe-4435-a8be-285afe1932d2 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:14:21.932582 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-de869bcf-eebe-4435-a8be-285afe1932d2 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:14:22.067129 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-de869bcf-eebe-4435-a8be-285afe1932d2 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac71714265342098d2487a701a6c364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f76a684261dd49f68a42a4e157355f37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:14:22.075735 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-de869bcf-eebe-4435-a8be-285afe1932d2 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] 10.222.0.20 "GET /compute/v2.1/servers/c2b0a742-21ea-4db3-bbe6-f261c65d7db6" status: 200 len: 1367 microversion: 2.1 time: 0.156396 Jul 01 04:14:22.076311 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 442/877] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:14:21 2022] GET /compute/v2.1/servers/c2b0a742-21ea-4db3-bbe6-f261c65d7db6 => generated 1367 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:14:22.202534 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-f6db399a-9a45-4ef1-9153-4b6e6b4f6efb tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 04:14:22.209703 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-f6db399a-9a45-4ef1-9153-4b6e6b4f6efb tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:14:22.215451 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-f6db399a-9a45-4ef1-9153-4b6e6b4f6efb tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:14:22.275590 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-f6db399a-9a45-4ef1-9153-4b6e6b4f6efb tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] [instance: 2e5d1edc-dbae-41dd-ab34-aa954b62f390] Going to try to stop instance {{(pid=118711) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 01 04:14:22.441460 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG dbcounter [-] [118711] Writing DB stats nova_cell0:SELECT=2 {{(pid=118711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:14:22.442174 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG dbcounter [-] [118711] Writing DB stats nova_cell0:SELECT=6 {{(pid=118711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:14:22.445151 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [req-343e69fe-55fd-4467-a619-783fe58b6d32 req-550b95e7-1312-4512-9c4a-2d4f39805622 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c2b0a742-21ea-4db3-bbe6-f261c65d7db6", "name": "network-vif-plugged", "status": "completed", "tag": "e85356b9-8a4c-49b0-95bc-3d8ba8e63319"}]} {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 04:14:22.454817 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [req-343e69fe-55fd-4467-a619-783fe58b6d32 req-550b95e7-1312-4512-9c4a-2d4f39805622 service nova] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:14:22.455299 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [req-343e69fe-55fd-4467-a619-783fe58b6d32 req-550b95e7-1312-4512-9c4a-2d4f39805622 service nova] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:14:22.466833 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.compute.server_external_events [req-343e69fe-55fd-4467-a619-783fe58b6d32 req-550b95e7-1312-4512-9c4a-2d4f39805622 service nova] Creating event network-vif-plugged:e85356b9-8a4c-49b0-95bc-3d8ba8e63319 for instance c2b0a742-21ea-4db3-bbe6-f261c65d7db6 on hv-cinder-84684 Jul 01 04:14:22.471775 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [req-343e69fe-55fd-4467-a619-783fe58b6d32 req-550b95e7-1312-4512-9c4a-2d4f39805622 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033617 Jul 01 04:14:22.473244 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 443/878] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Jul 1 04:14:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 04:14:22.604716 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-f6db399a-9a45-4ef1-9153-4b6e6b4f6efb tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] 10.222.0.20 "POST /compute/v2.1/servers/2e5d1edc-dbae-41dd-ab34-aa954b62f390/action" status: 202 len: 0 microversion: 2.1 time: 0.406729 Jul 01 04:14:22.605421 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 436/879] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Jul 1 04:14:22 2022] POST /compute/v2.1/servers/2e5d1edc-dbae-41dd-ab34-aa954b62f390/action => generated 0 bytes in 409 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 04:14:22.614434 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-61a02c81-4f88-4649-b2d6-d6af1eadc9c1 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:14:22.616953 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-61a02c81-4f88-4649-b2d6-d6af1eadc9c1 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] [instance: 2e5d1edc-dbae-41dd-ab34-aa954b62f390] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:14:22.621933 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-61a02c81-4f88-4649-b2d6-d6af1eadc9c1 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:14:22.622398 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-61a02c81-4f88-4649-b2d6-d6af1eadc9c1 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:14:22.623183 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-61a02c81-4f88-4649-b2d6-d6af1eadc9c1 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:14:22.623663 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-61a02c81-4f88-4649-b2d6-d6af1eadc9c1 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:14:22.661112 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG dbcounter [-] [118712] Writing DB stats nova_cell0:SELECT=6 {{(pid=118712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:14:22.781048 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-61a02c81-4f88-4649-b2d6-d6af1eadc9c1 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73d76a988462431fa6bb03dca64463a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9614129d1e864c3ea288aaac8387c5d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:14:22.789494 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-61a02c81-4f88-4649-b2d6-d6af1eadc9c1 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] 10.222.0.20 "GET /compute/v2.1/servers/2e5d1edc-dbae-41dd-ab34-aa954b62f390" status: 200 len: 1676 microversion: 2.1 time: 0.179465 Jul 01 04:14:22.789987 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 444/880] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:14:22 2022] GET /compute/v2.1/servers/2e5d1edc-dbae-41dd-ab34-aa954b62f390 => generated 1676 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:14:23.093797 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-9ad01fb7-dc2a-4caa-bd82-1663ccfc8b6f tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:14:23.094459 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-9ad01fb7-dc2a-4caa-bd82-1663ccfc8b6f tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] [instance: c2b0a742-21ea-4db3-bbe6-f261c65d7db6] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:14:23.100994 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-9ad01fb7-dc2a-4caa-bd82-1663ccfc8b6f tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:14:23.101445 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-9ad01fb7-dc2a-4caa-bd82-1663ccfc8b6f tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:14:23.102257 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-9ad01fb7-dc2a-4caa-bd82-1663ccfc8b6f tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:14:23.102692 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-9ad01fb7-dc2a-4caa-bd82-1663ccfc8b6f tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:14:23.238625 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-9ad01fb7-dc2a-4caa-bd82-1663ccfc8b6f tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac71714265342098d2487a701a6c364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f76a684261dd49f68a42a4e157355f37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:14:23.246874 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-9ad01fb7-dc2a-4caa-bd82-1663ccfc8b6f tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] 10.222.0.20 "GET /compute/v2.1/servers/c2b0a742-21ea-4db3-bbe6-f261c65d7db6" status: 200 len: 1367 microversion: 2.1 time: 0.157406 Jul 01 04:14:23.247489 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 437/881] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:14:23 2022] GET /compute/v2.1/servers/c2b0a742-21ea-4db3-bbe6-f261c65d7db6 => generated 1367 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:14:23.806020 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-ffdb7f9e-0fa8-4794-ba35-f8b614194587 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:14:23.806628 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-ffdb7f9e-0fa8-4794-ba35-f8b614194587 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] [instance: 2e5d1edc-dbae-41dd-ab34-aa954b62f390] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:14:23.813207 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-ffdb7f9e-0fa8-4794-ba35-f8b614194587 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:14:23.813655 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-ffdb7f9e-0fa8-4794-ba35-f8b614194587 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:14:23.814424 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-ffdb7f9e-0fa8-4794-ba35-f8b614194587 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:14:23.814863 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-ffdb7f9e-0fa8-4794-ba35-f8b614194587 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:14:23.949927 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-ffdb7f9e-0fa8-4794-ba35-f8b614194587 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73d76a988462431fa6bb03dca64463a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9614129d1e864c3ea288aaac8387c5d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:14:23.957620 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-ffdb7f9e-0fa8-4794-ba35-f8b614194587 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] 10.222.0.20 "GET /compute/v2.1/servers/2e5d1edc-dbae-41dd-ab34-aa954b62f390" status: 200 len: 1676 microversion: 2.1 time: 0.155490 Jul 01 04:14:23.958198 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 445/882] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:14:23 2022] GET /compute/v2.1/servers/2e5d1edc-dbae-41dd-ab34-aa954b62f390 => generated 1676 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:14:24.264586 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-f96e4f02-85dc-47e9-a945-c77b75a7f2bd tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:14:24.265201 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-f96e4f02-85dc-47e9-a945-c77b75a7f2bd tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] [instance: c2b0a742-21ea-4db3-bbe6-f261c65d7db6] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:14:24.271752 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-f96e4f02-85dc-47e9-a945-c77b75a7f2bd tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:14:24.272211 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-f96e4f02-85dc-47e9-a945-c77b75a7f2bd tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:14:24.272982 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-f96e4f02-85dc-47e9-a945-c77b75a7f2bd tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:14:24.273419 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-f96e4f02-85dc-47e9-a945-c77b75a7f2bd tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:14:24.407174 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-f96e4f02-85dc-47e9-a945-c77b75a7f2bd tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac71714265342098d2487a701a6c364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f76a684261dd49f68a42a4e157355f37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:14:24.416074 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-f96e4f02-85dc-47e9-a945-c77b75a7f2bd tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] 10.222.0.20 "GET /compute/v2.1/servers/c2b0a742-21ea-4db3-bbe6-f261c65d7db6" status: 200 len: 1557 microversion: 2.1 time: 0.155364 Jul 01 04:14:24.416660 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 438/883] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:14:24 2022] GET /compute/v2.1/servers/c2b0a742-21ea-4db3-bbe6-f261c65d7db6 => generated 1557 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:14:24.436210 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-ebdc7b79-cdd0-4c11-a050-ef1525c20b8f tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:14:24.436695 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-ebdc7b79-cdd0-4c11-a050-ef1525c20b8f tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] [instance: c2b0a742-21ea-4db3-bbe6-f261c65d7db6] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:14:24.442965 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-ebdc7b79-cdd0-4c11-a050-ef1525c20b8f tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:14:24.443620 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-ebdc7b79-cdd0-4c11-a050-ef1525c20b8f tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:14:24.444530 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-ebdc7b79-cdd0-4c11-a050-ef1525c20b8f tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:14:24.444969 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-ebdc7b79-cdd0-4c11-a050-ef1525c20b8f tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:14:24.526736 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-ebdc7b79-cdd0-4c11-a050-ef1525c20b8f tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] 10.222.0.20 "GET /compute/v2.1/servers/c2b0a742-21ea-4db3-bbe6-f261c65d7db6/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.094347 Jul 01 04:14:24.527367 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 446/884] 10.222.0.20 () {58 vars in 1274 bytes} [Fri Jul 1 04:14:24 2022] GET /compute/v2.1/servers/c2b0a742-21ea-4db3-bbe6-f261c65d7db6/os-interface => generated 284 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 04:14:24.974929 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-129d57ca-4f0f-4c85-aaef-55b17bfe70e1 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:14:24.975492 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-129d57ca-4f0f-4c85-aaef-55b17bfe70e1 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] [instance: 2e5d1edc-dbae-41dd-ab34-aa954b62f390] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:14:24.981609 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-129d57ca-4f0f-4c85-aaef-55b17bfe70e1 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:14:24.982063 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-129d57ca-4f0f-4c85-aaef-55b17bfe70e1 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:14:24.982859 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-129d57ca-4f0f-4c85-aaef-55b17bfe70e1 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:14:24.983323 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-129d57ca-4f0f-4c85-aaef-55b17bfe70e1 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:14:25.195643 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-129d57ca-4f0f-4c85-aaef-55b17bfe70e1 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73d76a988462431fa6bb03dca64463a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9614129d1e864c3ea288aaac8387c5d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:14:25.206208 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-129d57ca-4f0f-4c85-aaef-55b17bfe70e1 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] 10.222.0.20 "GET /compute/v2.1/servers/2e5d1edc-dbae-41dd-ab34-aa954b62f390" status: 200 len: 1676 microversion: 2.1 time: 0.235077 Jul 01 04:14:25.207096 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 439/885] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:14:24 2022] GET /compute/v2.1/servers/2e5d1edc-dbae-41dd-ab34-aa954b62f390 => generated 1676 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:14:25.660425 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [req-d1c2bd30-ba64-4efa-bfd3-001a927a96d1 req-4ab23c59-e365-481a-83ac-097860e51e7e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c2b0a742-21ea-4db3-bbe6-f261c65d7db6", "tag": "e85356b9-8a4c-49b0-95bc-3d8ba8e63319"}]} {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 04:14:25.670893 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [req-d1c2bd30-ba64-4efa-bfd3-001a927a96d1 req-4ab23c59-e365-481a-83ac-097860e51e7e service nova] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:14:25.671498 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [req-d1c2bd30-ba64-4efa-bfd3-001a927a96d1 req-4ab23c59-e365-481a-83ac-097860e51e7e service nova] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:14:25.684533 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.compute.server_external_events [req-d1c2bd30-ba64-4efa-bfd3-001a927a96d1 req-4ab23c59-e365-481a-83ac-097860e51e7e service nova] Creating event network-changed:e85356b9-8a4c-49b0-95bc-3d8ba8e63319 for instance c2b0a742-21ea-4db3-bbe6-f261c65d7db6 on hv-cinder-84684 Jul 01 04:14:25.690077 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [req-d1c2bd30-ba64-4efa-bfd3-001a927a96d1 req-4ab23c59-e365-481a-83ac-097860e51e7e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034812 Jul 01 04:14:25.690889 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 447/886] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Jul 1 04:14:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 01 04:14:26.225324 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-c4ee24ed-670f-4a56-a026-b4a030d2a490 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:14:26.226245 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-c4ee24ed-670f-4a56-a026-b4a030d2a490 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] [instance: 2e5d1edc-dbae-41dd-ab34-aa954b62f390] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:14:26.233258 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-c4ee24ed-670f-4a56-a026-b4a030d2a490 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:14:26.233597 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-c4ee24ed-670f-4a56-a026-b4a030d2a490 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:14:26.234597 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-c4ee24ed-670f-4a56-a026-b4a030d2a490 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:14:26.235031 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-c4ee24ed-670f-4a56-a026-b4a030d2a490 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:14:26.415306 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-c4ee24ed-670f-4a56-a026-b4a030d2a490 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73d76a988462431fa6bb03dca64463a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9614129d1e864c3ea288aaac8387c5d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:14:26.423247 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-c4ee24ed-670f-4a56-a026-b4a030d2a490 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] 10.222.0.20 "GET /compute/v2.1/servers/2e5d1edc-dbae-41dd-ab34-aa954b62f390" status: 200 len: 1676 microversion: 2.1 time: 0.202266 Jul 01 04:14:26.423835 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 440/887] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:14:26 2022] GET /compute/v2.1/servers/2e5d1edc-dbae-41dd-ab34-aa954b62f390 => generated 1676 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:14:27.442940 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-cc685aac-6f7b-4458-9696-b79002292e26 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:14:27.443693 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-cc685aac-6f7b-4458-9696-b79002292e26 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] [instance: 2e5d1edc-dbae-41dd-ab34-aa954b62f390] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:14:27.453294 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-cc685aac-6f7b-4458-9696-b79002292e26 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:14:27.454098 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-cc685aac-6f7b-4458-9696-b79002292e26 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:14:27.455501 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-cc685aac-6f7b-4458-9696-b79002292e26 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:14:27.456309 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-cc685aac-6f7b-4458-9696-b79002292e26 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:14:27.605950 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-cc685aac-6f7b-4458-9696-b79002292e26 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73d76a988462431fa6bb03dca64463a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9614129d1e864c3ea288aaac8387c5d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:14:27.614021 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-cc685aac-6f7b-4458-9696-b79002292e26 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] 10.222.0.20 "GET /compute/v2.1/servers/2e5d1edc-dbae-41dd-ab34-aa954b62f390" status: 200 len: 1676 microversion: 2.1 time: 0.176142 Jul 01 04:14:27.614599 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 448/888] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:14:27 2022] GET /compute/v2.1/servers/2e5d1edc-dbae-41dd-ab34-aa954b62f390 => generated 1676 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:14:28.631076 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-7394a8c0-58d3-4074-89f8-026f8d615b69 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:14:28.632219 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-7394a8c0-58d3-4074-89f8-026f8d615b69 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] [instance: 2e5d1edc-dbae-41dd-ab34-aa954b62f390] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:14:28.639538 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-7394a8c0-58d3-4074-89f8-026f8d615b69 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:14:28.640003 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-7394a8c0-58d3-4074-89f8-026f8d615b69 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:14:28.640860 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-7394a8c0-58d3-4074-89f8-026f8d615b69 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:14:28.641316 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-7394a8c0-58d3-4074-89f8-026f8d615b69 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:14:28.783802 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-7394a8c0-58d3-4074-89f8-026f8d615b69 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73d76a988462431fa6bb03dca64463a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9614129d1e864c3ea288aaac8387c5d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:14:28.791798 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-7394a8c0-58d3-4074-89f8-026f8d615b69 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] 10.222.0.20 "GET /compute/v2.1/servers/2e5d1edc-dbae-41dd-ab34-aa954b62f390" status: 200 len: 1676 microversion: 2.1 time: 0.164438 Jul 01 04:14:28.792393 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 441/889] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:14:28 2022] GET /compute/v2.1/servers/2e5d1edc-dbae-41dd-ab34-aa954b62f390 => generated 1676 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:14:29.809184 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-bb1a02d7-22d8-4369-bfac-6bb72ba247a9 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:14:29.809744 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-bb1a02d7-22d8-4369-bfac-6bb72ba247a9 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] [instance: 2e5d1edc-dbae-41dd-ab34-aa954b62f390] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:14:29.816271 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-bb1a02d7-22d8-4369-bfac-6bb72ba247a9 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:14:29.821049 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-bb1a02d7-22d8-4369-bfac-6bb72ba247a9 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:14:29.821049 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-bb1a02d7-22d8-4369-bfac-6bb72ba247a9 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:14:29.821049 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-bb1a02d7-22d8-4369-bfac-6bb72ba247a9 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:14:30.001853 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-bb1a02d7-22d8-4369-bfac-6bb72ba247a9 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73d76a988462431fa6bb03dca64463a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9614129d1e864c3ea288aaac8387c5d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:14:30.009466 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-bb1a02d7-22d8-4369-bfac-6bb72ba247a9 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] 10.222.0.20 "GET /compute/v2.1/servers/2e5d1edc-dbae-41dd-ab34-aa954b62f390" status: 200 len: 1676 microversion: 2.1 time: 0.204373 Jul 01 04:14:30.010038 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 449/890] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:14:29 2022] GET /compute/v2.1/servers/2e5d1edc-dbae-41dd-ab34-aa954b62f390 => generated 1676 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:14:31.030857 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-c8dc41e7-754c-48ce-b95d-a147f70c6670 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:14:31.031540 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-c8dc41e7-754c-48ce-b95d-a147f70c6670 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] [instance: 2e5d1edc-dbae-41dd-ab34-aa954b62f390] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:14:31.038403 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-c8dc41e7-754c-48ce-b95d-a147f70c6670 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:14:31.038856 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-c8dc41e7-754c-48ce-b95d-a147f70c6670 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:14:31.039668 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-c8dc41e7-754c-48ce-b95d-a147f70c6670 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:14:31.040142 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-c8dc41e7-754c-48ce-b95d-a147f70c6670 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:14:31.230718 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-c8dc41e7-754c-48ce-b95d-a147f70c6670 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73d76a988462431fa6bb03dca64463a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9614129d1e864c3ea288aaac8387c5d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:14:31.238489 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-c8dc41e7-754c-48ce-b95d-a147f70c6670 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] 10.222.0.20 "GET /compute/v2.1/servers/2e5d1edc-dbae-41dd-ab34-aa954b62f390" status: 200 len: 1676 microversion: 2.1 time: 0.211487 Jul 01 04:14:31.239057 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 442/891] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:14:31 2022] GET /compute/v2.1/servers/2e5d1edc-dbae-41dd-ab34-aa954b62f390 => generated 1676 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:14:32.256565 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-dba5fbdc-694c-44b8-aa8a-d48cae72f5e9 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:14:32.257851 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-dba5fbdc-694c-44b8-aa8a-d48cae72f5e9 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] [instance: 2e5d1edc-dbae-41dd-ab34-aa954b62f390] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:14:32.260270 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG dbcounter [-] [118712] Writing DB stats nova_api:SELECT=56,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=118712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:14:32.265455 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-dba5fbdc-694c-44b8-aa8a-d48cae72f5e9 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:14:32.265913 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-dba5fbdc-694c-44b8-aa8a-d48cae72f5e9 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:14:32.266781 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-dba5fbdc-694c-44b8-aa8a-d48cae72f5e9 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:14:32.267244 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-dba5fbdc-694c-44b8-aa8a-d48cae72f5e9 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:14:32.410462 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-dba5fbdc-694c-44b8-aa8a-d48cae72f5e9 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73d76a988462431fa6bb03dca64463a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9614129d1e864c3ea288aaac8387c5d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:14:32.418794 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-dba5fbdc-694c-44b8-aa8a-d48cae72f5e9 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] 10.222.0.20 "GET /compute/v2.1/servers/2e5d1edc-dbae-41dd-ab34-aa954b62f390" status: 200 len: 1676 microversion: 2.1 time: 0.166562 Jul 01 04:14:32.419404 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 450/892] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:14:32 2022] GET /compute/v2.1/servers/2e5d1edc-dbae-41dd-ab34-aa954b62f390 => generated 1676 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:14:33.437267 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-84d4e747-18ec-4f88-a56b-77cb829f9865 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:14:33.437832 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-84d4e747-18ec-4f88-a56b-77cb829f9865 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] [instance: 2e5d1edc-dbae-41dd-ab34-aa954b62f390] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:14:33.440202 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG dbcounter [-] [118711] Writing DB stats nova_api:SELECT=54,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=118711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:14:33.445920 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-84d4e747-18ec-4f88-a56b-77cb829f9865 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:14:33.447302 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-84d4e747-18ec-4f88-a56b-77cb829f9865 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:14:33.447302 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-84d4e747-18ec-4f88-a56b-77cb829f9865 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:14:33.447588 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-84d4e747-18ec-4f88-a56b-77cb829f9865 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:14:33.587012 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-84d4e747-18ec-4f88-a56b-77cb829f9865 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73d76a988462431fa6bb03dca64463a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9614129d1e864c3ea288aaac8387c5d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:14:33.594514 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-84d4e747-18ec-4f88-a56b-77cb829f9865 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] 10.222.0.20 "GET /compute/v2.1/servers/2e5d1edc-dbae-41dd-ab34-aa954b62f390" status: 200 len: 1653 microversion: 2.1 time: 0.161292 Jul 01 04:14:33.595069 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 443/893] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:14:33 2022] GET /compute/v2.1/servers/2e5d1edc-dbae-41dd-ab34-aa954b62f390 => generated 1653 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:14:33.610952 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-0048169e-f5f0-45d5-bd3c-d41e5e5fb9fd tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 04:14:33.618434 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-0048169e-f5f0-45d5-bd3c-d41e5e5fb9fd tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:14:33.618974 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-0048169e-f5f0-45d5-bd3c-d41e5e5fb9fd tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:14:33.642087 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-0048169e-f5f0-45d5-bd3c-d41e5e5fb9fd tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] [instance: 2e5d1edc-dbae-41dd-ab34-aa954b62f390] Going to try to start instance {{(pid=118712) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 01 04:14:33.842820 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-0048169e-f5f0-45d5-bd3c-d41e5e5fb9fd tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] 10.222.0.20 "POST /compute/v2.1/servers/2e5d1edc-dbae-41dd-ab34-aa954b62f390/action" status: 202 len: 0 microversion: 2.1 time: 0.235445 Jul 01 04:14:33.843466 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 451/894] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Jul 1 04:14:33 2022] POST /compute/v2.1/servers/2e5d1edc-dbae-41dd-ab34-aa954b62f390/action => generated 0 bytes in 237 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 04:14:33.852254 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-ce352f16-fec9-4d57-9d0e-3c1027ee8226 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:14:33.855585 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-ce352f16-fec9-4d57-9d0e-3c1027ee8226 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] [instance: 2e5d1edc-dbae-41dd-ab34-aa954b62f390] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:14:33.859346 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-ce352f16-fec9-4d57-9d0e-3c1027ee8226 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:14:33.860527 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-ce352f16-fec9-4d57-9d0e-3c1027ee8226 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:14:33.860710 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-ce352f16-fec9-4d57-9d0e-3c1027ee8226 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:14:33.861030 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-ce352f16-fec9-4d57-9d0e-3c1027ee8226 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:14:34.009812 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-ce352f16-fec9-4d57-9d0e-3c1027ee8226 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73d76a988462431fa6bb03dca64463a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9614129d1e864c3ea288aaac8387c5d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:14:34.018852 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-ce352f16-fec9-4d57-9d0e-3c1027ee8226 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] 10.222.0.20 "GET /compute/v2.1/servers/2e5d1edc-dbae-41dd-ab34-aa954b62f390" status: 200 len: 1662 microversion: 2.1 time: 0.170995 Jul 01 04:14:34.019697 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 444/895] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:14:33 2022] GET /compute/v2.1/servers/2e5d1edc-dbae-41dd-ab34-aa954b62f390 => generated 1662 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:14:35.039791 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-8465981e-d853-4790-a270-c5be452d5796 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:14:35.040755 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-8465981e-d853-4790-a270-c5be452d5796 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] [instance: 2e5d1edc-dbae-41dd-ab34-aa954b62f390] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:14:35.049399 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-8465981e-d853-4790-a270-c5be452d5796 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:14:35.050060 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-8465981e-d853-4790-a270-c5be452d5796 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:14:35.050935 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-8465981e-d853-4790-a270-c5be452d5796 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:14:35.051517 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-8465981e-d853-4790-a270-c5be452d5796 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:14:35.204569 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-8465981e-d853-4790-a270-c5be452d5796 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73d76a988462431fa6bb03dca64463a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9614129d1e864c3ea288aaac8387c5d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:14:35.213810 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-8465981e-d853-4790-a270-c5be452d5796 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] 10.222.0.20 "GET /compute/v2.1/servers/2e5d1edc-dbae-41dd-ab34-aa954b62f390" status: 200 len: 1662 microversion: 2.1 time: 0.179806 Jul 01 04:14:35.214579 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 452/896] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:14:35 2022] GET /compute/v2.1/servers/2e5d1edc-dbae-41dd-ab34-aa954b62f390 => generated 1662 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:14:36.231481 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-ad9a2fa9-819c-4c01-9b4f-dc8473f7e5cf tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:14:36.232122 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-ad9a2fa9-819c-4c01-9b4f-dc8473f7e5cf tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] [instance: 2e5d1edc-dbae-41dd-ab34-aa954b62f390] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:14:36.239083 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-ad9a2fa9-819c-4c01-9b4f-dc8473f7e5cf tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:14:36.239571 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-ad9a2fa9-819c-4c01-9b4f-dc8473f7e5cf tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:14:36.240362 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-ad9a2fa9-819c-4c01-9b4f-dc8473f7e5cf tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:14:36.240837 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-ad9a2fa9-819c-4c01-9b4f-dc8473f7e5cf tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:14:36.669125 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-ad9a2fa9-819c-4c01-9b4f-dc8473f7e5cf tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73d76a988462431fa6bb03dca64463a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9614129d1e864c3ea288aaac8387c5d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:14:36.681777 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-ad9a2fa9-819c-4c01-9b4f-dc8473f7e5cf tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] 10.222.0.20 "GET /compute/v2.1/servers/2e5d1edc-dbae-41dd-ab34-aa954b62f390" status: 200 len: 1666 microversion: 2.1 time: 0.453140 Jul 01 04:14:36.683285 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 445/897] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:14:36 2022] GET /compute/v2.1/servers/2e5d1edc-dbae-41dd-ab34-aa954b62f390 => generated 1666 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:15:01.892547 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-d37b3bb6-dfd1-4a50-b709-a1b09272bee8 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:15:01.892996 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-d37b3bb6-dfd1-4a50-b709-a1b09272bee8 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] [instance: c2b0a742-21ea-4db3-bbe6-f261c65d7db6] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:15:01.895407 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG dbcounter [-] [118712] Writing DB stats nova_api:SELECT=5 {{(pid=118712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:15:01.896078 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG dbcounter [-] [118712] Writing DB stats nova_cell1:SELECT=73,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:15:01.903142 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-d37b3bb6-dfd1-4a50-b709-a1b09272bee8 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:15:01.906168 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-d37b3bb6-dfd1-4a50-b709-a1b09272bee8 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:15:01.906168 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-d37b3bb6-dfd1-4a50-b709-a1b09272bee8 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:15:01.906168 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-d37b3bb6-dfd1-4a50-b709-a1b09272bee8 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:15:01.929529 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-d37b3bb6-dfd1-4a50-b709-a1b09272bee8 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] 10.222.0.20 "GET /compute/v2.1/servers/c2b0a742-21ea-4db3-bbe6-f261c65d7db6/ips" status: 200 len: 149 microversion: 2.1 time: 0.041202 Jul 01 04:15:01.934747 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 453/898] 10.222.0.20 () {58 vars in 1247 bytes} [Fri Jul 1 04:15:01 2022] GET /compute/v2.1/servers/c2b0a742-21ea-4db3-bbe6-f261c65d7db6/ips => generated 149 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 04:15:03.538202 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-dd6213ca-c89a-4004-af0b-cfe78d44f95e tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a47449cc-554c-4a52-ad89-570132a3c88b"}} {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 04:15:03.539446 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-dd6213ca-c89a-4004-af0b-cfe78d44f95e tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] [instance: c2b0a742-21ea-4db3-bbe6-f261c65d7db6] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:15:03.541542 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG dbcounter [-] [118711] Writing DB stats nova_api:SELECT=5 {{(pid=118711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:15:03.542199 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG dbcounter [-] [118711] Writing DB stats nova_cell1:SELECT=90,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=118711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:15:03.548086 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-dd6213ca-c89a-4004-af0b-cfe78d44f95e tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:15:03.548540 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-dd6213ca-c89a-4004-af0b-cfe78d44f95e tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:15:03.549322 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-dd6213ca-c89a-4004-af0b-cfe78d44f95e tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:15:03.549757 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-dd6213ca-c89a-4004-af0b-cfe78d44f95e tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:15:04.426475 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-dd6213ca-c89a-4004-af0b-cfe78d44f95e tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] 10.222.0.20 "POST /compute/v2.1/servers/c2b0a742-21ea-4db3-bbe6-f261c65d7db6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.892421 Jul 01 04:15:04.427005 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 446/899] 10.222.0.20 () {60 vars in 1322 bytes} [Fri Jul 1 04:15:03 2022] POST /compute/v2.1/servers/c2b0a742-21ea-4db3-bbe6-f261c65d7db6/os-volume_attachments => generated 194 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 04:15:09.027341 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-b02449df-1950-4b76-84f5-056bb6806dee tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:15:09.028266 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-b02449df-1950-4b76-84f5-056bb6806dee tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] [instance: 2e5d1edc-dbae-41dd-ab34-aa954b62f390] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:15:09.034791 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-b02449df-1950-4b76-84f5-056bb6806dee tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:15:09.035263 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-b02449df-1950-4b76-84f5-056bb6806dee tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:15:09.036034 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-b02449df-1950-4b76-84f5-056bb6806dee tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:15:09.036505 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-b02449df-1950-4b76-84f5-056bb6806dee tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:15:09.065596 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-b02449df-1950-4b76-84f5-056bb6806dee tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] 10.222.0.20 "GET /compute/v2.1/servers/2e5d1edc-dbae-41dd-ab34-aa954b62f390/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042347 Jul 01 04:15:09.066153 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 454/900] 10.222.0.20 () {58 vars in 1301 bytes} [Fri Jul 1 04:15:09 2022] GET /compute/v2.1/servers/2e5d1edc-dbae-41dd-ab34-aa954b62f390/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 01 04:15:09.135440 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-72775f17-3806-4adb-93ac-0be6ab9d65d7 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:15:09.136032 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-72775f17-3806-4adb-93ac-0be6ab9d65d7 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] [instance: 2e5d1edc-dbae-41dd-ab34-aa954b62f390] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:15:09.142232 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-72775f17-3806-4adb-93ac-0be6ab9d65d7 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:15:09.142682 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-72775f17-3806-4adb-93ac-0be6ab9d65d7 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:15:09.143477 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-72775f17-3806-4adb-93ac-0be6ab9d65d7 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:15:09.143920 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-72775f17-3806-4adb-93ac-0be6ab9d65d7 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:15:09.168537 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-72775f17-3806-4adb-93ac-0be6ab9d65d7 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] [instance: 2e5d1edc-dbae-41dd-ab34-aa954b62f390] Going to try to terminate instance {{(pid=118711) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 01 04:15:09.445209 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-72775f17-3806-4adb-93ac-0be6ab9d65d7 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] 10.222.0.20 "DELETE /compute/v2.1/servers/2e5d1edc-dbae-41dd-ab34-aa954b62f390" status: 204 len: 0 microversion: 2.1 time: 0.314543 Jul 01 04:15:09.445792 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 447/901] 10.222.0.20 () {58 vars in 1238 bytes} [Fri Jul 1 04:15:09 2022] DELETE /compute/v2.1/servers/2e5d1edc-dbae-41dd-ab34-aa954b62f390 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 01 04:15:09.454499 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-15b7d10a-3aed-43cf-ae8f-7cdb6506ec61 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:15:09.455103 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-15b7d10a-3aed-43cf-ae8f-7cdb6506ec61 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] [instance: 2e5d1edc-dbae-41dd-ab34-aa954b62f390] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:15:09.461697 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-15b7d10a-3aed-43cf-ae8f-7cdb6506ec61 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:15:09.462158 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-15b7d10a-3aed-43cf-ae8f-7cdb6506ec61 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:15:09.462968 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-15b7d10a-3aed-43cf-ae8f-7cdb6506ec61 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:15:09.463461 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-15b7d10a-3aed-43cf-ae8f-7cdb6506ec61 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:15:09.595797 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-15b7d10a-3aed-43cf-ae8f-7cdb6506ec61 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73d76a988462431fa6bb03dca64463a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9614129d1e864c3ea288aaac8387c5d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:15:09.603399 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-15b7d10a-3aed-43cf-ae8f-7cdb6506ec61 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] 10.222.0.20 "GET /compute/v2.1/servers/2e5d1edc-dbae-41dd-ab34-aa954b62f390" status: 200 len: 1672 microversion: 2.1 time: 0.153136 Jul 01 04:15:09.603973 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 455/902] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:15:09 2022] GET /compute/v2.1/servers/2e5d1edc-dbae-41dd-ab34-aa954b62f390 => generated 1672 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:15:10.621809 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-a8041e1f-cb41-428f-a3ef-dd5d0e0709ed tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:15:10.622538 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-a8041e1f-cb41-428f-a3ef-dd5d0e0709ed tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] [instance: 2e5d1edc-dbae-41dd-ab34-aa954b62f390] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:15:10.629620 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-a8041e1f-cb41-428f-a3ef-dd5d0e0709ed tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:15:10.630101 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-a8041e1f-cb41-428f-a3ef-dd5d0e0709ed tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:15:10.630874 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-a8041e1f-cb41-428f-a3ef-dd5d0e0709ed tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:15:10.631358 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-a8041e1f-cb41-428f-a3ef-dd5d0e0709ed tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:15:10.762944 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-a8041e1f-cb41-428f-a3ef-dd5d0e0709ed tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73d76a988462431fa6bb03dca64463a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9614129d1e864c3ea288aaac8387c5d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:15:10.771028 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-a8041e1f-cb41-428f-a3ef-dd5d0e0709ed tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] 10.222.0.20 "GET /compute/v2.1/servers/2e5d1edc-dbae-41dd-ab34-aa954b62f390" status: 200 len: 1672 microversion: 2.1 time: 0.153376 Jul 01 04:15:10.771909 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 448/903] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:15:10 2022] GET /compute/v2.1/servers/2e5d1edc-dbae-41dd-ab34-aa954b62f390 => generated 1672 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:15:11.789421 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-73c415f0-4311-4e43-b1e5-116be1d46af4 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:15:11.790044 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-73c415f0-4311-4e43-b1e5-116be1d46af4 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] [instance: 2e5d1edc-dbae-41dd-ab34-aa954b62f390] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:15:11.796245 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-73c415f0-4311-4e43-b1e5-116be1d46af4 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:15:11.803150 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-73c415f0-4311-4e43-b1e5-116be1d46af4 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:15:11.803150 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-73c415f0-4311-4e43-b1e5-116be1d46af4 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:15:11.803150 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-73c415f0-4311-4e43-b1e5-116be1d46af4 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:15:11.945871 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-73c415f0-4311-4e43-b1e5-116be1d46af4 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73d76a988462431fa6bb03dca64463a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9614129d1e864c3ea288aaac8387c5d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:15:11.953927 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-73c415f0-4311-4e43-b1e5-116be1d46af4 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] 10.222.0.20 "GET /compute/v2.1/servers/2e5d1edc-dbae-41dd-ab34-aa954b62f390" status: 200 len: 1672 microversion: 2.1 time: 0.168223 Jul 01 04:15:11.954518 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 456/904] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:15:11 2022] GET /compute/v2.1/servers/2e5d1edc-dbae-41dd-ab34-aa954b62f390 => generated 1672 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:15:12.593078 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [req-cf68edfb-8e7d-40b9-bbe9-49ba12b5ca35 req-91a51146-2c01-4456-9cd0-e1314e9cdb5e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e5d1edc-dbae-41dd-ab34-aa954b62f390", "name": "network-vif-deleted", "tag": "fc978023-4a63-4cbc-bcf9-4541918a2a6d"}]} {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 04:15:12.602563 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [req-cf68edfb-8e7d-40b9-bbe9-49ba12b5ca35 req-91a51146-2c01-4456-9cd0-e1314e9cdb5e service nova] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:15:12.602966 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [req-cf68edfb-8e7d-40b9-bbe9-49ba12b5ca35 req-91a51146-2c01-4456-9cd0-e1314e9cdb5e service nova] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:15:12.615827 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.compute.server_external_events [req-cf68edfb-8e7d-40b9-bbe9-49ba12b5ca35 req-91a51146-2c01-4456-9cd0-e1314e9cdb5e service nova] Creating event network-vif-deleted:fc978023-4a63-4cbc-bcf9-4541918a2a6d for instance 2e5d1edc-dbae-41dd-ab34-aa954b62f390 on hv-cinder-84684 Jul 01 04:15:12.621641 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [req-cf68edfb-8e7d-40b9-bbe9-49ba12b5ca35 req-91a51146-2c01-4456-9cd0-e1314e9cdb5e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095968 Jul 01 04:15:12.622577 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 449/905] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Jul 1 04:15:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 04:15:12.977947 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-cb3c3a5a-4c8d-4944-abd7-b4f472927dea tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:15:12.979318 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-cb3c3a5a-4c8d-4944-abd7-b4f472927dea tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] [instance: 2e5d1edc-dbae-41dd-ab34-aa954b62f390] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:15:12.986165 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-cb3c3a5a-4c8d-4944-abd7-b4f472927dea tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:15:12.986626 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-cb3c3a5a-4c8d-4944-abd7-b4f472927dea tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:15:12.987439 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-cb3c3a5a-4c8d-4944-abd7-b4f472927dea tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:15:12.987880 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-cb3c3a5a-4c8d-4944-abd7-b4f472927dea tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:15:13.029632 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-cb3c3a5a-4c8d-4944-abd7-b4f472927dea tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:15:13.030094 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-cb3c3a5a-4c8d-4944-abd7-b4f472927dea tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:15:13.030551 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.objects.instance [None req-cb3c3a5a-4c8d-4944-abd7-b4f472927dea tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lazy-loading 'fault' on Instance uuid 2e5d1edc-dbae-41dd-ab34-aa954b62f390 {{(pid=118712) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 04:15:13.073722 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-cb3c3a5a-4c8d-4944-abd7-b4f472927dea tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73d76a988462431fa6bb03dca64463a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9614129d1e864c3ea288aaac8387c5d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:15:13.082576 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-cb3c3a5a-4c8d-4944-abd7-b4f472927dea tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] 10.222.0.20 "GET /compute/v2.1/servers/2e5d1edc-dbae-41dd-ab34-aa954b62f390" status: 200 len: 1326 microversion: 2.1 time: 0.108327 Jul 01 04:15:13.083246 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 457/906] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:15:12 2022] GET /compute/v2.1/servers/2e5d1edc-dbae-41dd-ab34-aa954b62f390 => generated 1326 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:15:13.107472 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-bd3a3f9f-bd03-4dca-a4ae-af9b3aec2f04 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:15:13.108068 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-bd3a3f9f-bd03-4dca-a4ae-af9b3aec2f04 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] [instance: c2b0a742-21ea-4db3-bbe6-f261c65d7db6] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:15:13.114400 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-bd3a3f9f-bd03-4dca-a4ae-af9b3aec2f04 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:15:13.114858 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-bd3a3f9f-bd03-4dca-a4ae-af9b3aec2f04 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:15:13.115685 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-bd3a3f9f-bd03-4dca-a4ae-af9b3aec2f04 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:15:13.116310 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-bd3a3f9f-bd03-4dca-a4ae-af9b3aec2f04 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:15:13.205423 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.objects.instance [None req-bd3a3f9f-bd03-4dca-a4ae-af9b3aec2f04 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lazy-loading 'services' on Instance uuid c2b0a742-21ea-4db3-bbe6-f261c65d7db6 {{(pid=118711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 04:15:13.467466 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-bd3a3f9f-bd03-4dca-a4ae-af9b3aec2f04 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] 10.222.0.20 "DELETE /compute/v2.1/servers/c2b0a742-21ea-4db3-bbe6-f261c65d7db6/os-volume_attachments/a47449cc-554c-4a52-ad89-570132a3c88b" status: 202 len: 0 microversion: 2.1 time: 0.364154 Jul 01 04:15:13.470189 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 450/907] 10.222.0.20 () {58 vars in 1415 bytes} [Fri Jul 1 04:15:13 2022] DELETE /compute/v2.1/servers/c2b0a742-21ea-4db3-bbe6-f261c65d7db6/os-volume_attachments/a47449cc-554c-4a52-ad89-570132a3c88b => generated 0 bytes in 366 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 04:15:13.476417 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-c973e7b7-36ed-4117-aee7-e7bda2d269fe tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:15:13.477357 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-c973e7b7-36ed-4117-aee7-e7bda2d269fe tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] [instance: c2b0a742-21ea-4db3-bbe6-f261c65d7db6] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:15:13.484271 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-c973e7b7-36ed-4117-aee7-e7bda2d269fe tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:15:13.484740 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-c973e7b7-36ed-4117-aee7-e7bda2d269fe tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:15:13.485589 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-c973e7b7-36ed-4117-aee7-e7bda2d269fe tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:15:13.486027 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-c973e7b7-36ed-4117-aee7-e7bda2d269fe tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:15:13.518186 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-c973e7b7-36ed-4117-aee7-e7bda2d269fe tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] 10.222.0.20 "GET /compute/v2.1/servers/c2b0a742-21ea-4db3-bbe6-f261c65d7db6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045614 Jul 01 04:15:13.518675 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 458/908] 10.222.0.20 () {58 vars in 1301 bytes} [Fri Jul 1 04:15:13 2022] GET /compute/v2.1/servers/c2b0a742-21ea-4db3-bbe6-f261c65d7db6/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 04:15:14.101024 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-5cb3c260-51ee-4885-95ee-3a7db0f169c9 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:15:14.103396 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-5cb3c260-51ee-4885-95ee-3a7db0f169c9 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] [instance: 2e5d1edc-dbae-41dd-ab34-aa954b62f390] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:15:14.108654 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-5cb3c260-51ee-4885-95ee-3a7db0f169c9 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:15:14.109168 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-5cb3c260-51ee-4885-95ee-3a7db0f169c9 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:15:14.109936 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-5cb3c260-51ee-4885-95ee-3a7db0f169c9 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:15:14.110380 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-5cb3c260-51ee-4885-95ee-3a7db0f169c9 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:15:14.123639 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.wsgi [None req-5cb3c260-51ee-4885-95ee-3a7db0f169c9 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] HTTP exception thrown: Instance 2e5d1edc-dbae-41dd-ab34-aa954b62f390 could not be found. Jul 01 04:15:14.125269 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-5cb3c260-51ee-4885-95ee-3a7db0f169c9 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Request method failure captured: Jul 01 04:15:14.125269 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: request: GET /compute/v2.1/servers/2e5d1edc-dbae-41dd-ab34-aa954b62f390 HTTP/1.1 Jul 01 04:15:14.125269 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: Accept: application/json Jul 01 04:15:14.125269 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: Accept-Encoding: identity Jul 01 04:15:14.125269 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: Connection: close Jul 01 04:15:14.125269 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: Content-Length: 0 Jul 01 04:15:14.125269 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: Content-Type: application/json Jul 01 04:15:14.125269 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: Host: 10.222.0.20 Jul 01 04:15:14.125269 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: Openstack-System-Scope: None Jul 01 04:15:14.125269 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: User-Agent: python-urllib3/1.26.9 Jul 01 04:15:14.125269 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-Auth-Token: gAAAAABivnQhBYAO9PNA930KsaYPgDPjv2L4uIu6ObYzCjMzkLGwQYsPy6iHjK1QEG6tUpDuhNy6GRQbAGDaT8BkVKQ19TstKXrsmZ9U3f_tiqi-7Aap4Qgv-AWKQLYpGLFR8YqULb2p1N7vBmZMZvjQPe0nAdgt2UjyXGoi7zYaI6UFjR5KpQg Jul 01 04:15:14.125269 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-Domain-Id: None Jul 01 04:15:14.125269 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-Domain-Name: None Jul 01 04:15:14.125269 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-Identity-Status: Confirmed Jul 01 04:15:14.125269 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-Is-Admin-Project: True Jul 01 04:15:14.125269 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-Project-Domain-Id: default Jul 01 04:15:14.125269 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-Project-Domain-Name: Default Jul 01 04:15:14.125269 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-Project-Id: 9614129d1e864c3ea288aaac8387c5d1 Jul 01 04:15:14.125269 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-Project-Name: tempest-AttachVolumeTestJSON-416529265 Jul 01 04:15:14.125269 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-Role: reader,member Jul 01 04:15:14.125269 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-Roles: reader,member Jul 01 04:15:14.126924 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/9614129d1e864c3ea288aaac8387c5d1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_9614129d1e864c3ea288aaac8387c5d1", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9614129d1e864c3ea288aaac8387c5d1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9614129d1e864c3ea288aaac8387c5d1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}] Jul 01 04:15:14.126924 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-Tenant: tempest-AttachVolumeTestJSON-416529265 Jul 01 04:15:14.126924 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-Tenant-Id: 9614129d1e864c3ea288aaac8387c5d1 Jul 01 04:15:14.126924 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-Tenant-Name: tempest-AttachVolumeTestJSON-416529265 Jul 01 04:15:14.126924 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-User: tempest-AttachVolumeTestJSON-416529265-project Jul 01 04:15:14.126924 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-User-Domain-Id: default Jul 01 04:15:14.126924 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-User-Domain-Name: Default Jul 01 04:15:14.126924 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-User-Id: 73d76a988462431fa6bb03dca64463a4 Jul 01 04:15:14.126924 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-User-Name: tempest-AttachVolumeTestJSON-416529265-project Jul 01 04:15:14.126924 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: method: > Jul 01 04:15:14.126924 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: exception: Instance 2e5d1edc-dbae-41dd-ab34-aa954b62f390 could not be found. Jul 01 04:15:14.126924 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: action_args: {'id': '2e5d1edc-dbae-41dd-ab34-aa954b62f390'} Jul 01 04:15:14.127851 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 04:15:14.127851 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 04:15:14.127851 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 04:15:14.127851 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 04:15:14.127851 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 04:15:14.127851 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 04:15:14.127851 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 04:15:14.127851 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 04:15:14.127851 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 04:15:14.127851 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 04:15:14.127851 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2e5d1edc-dbae-41dd-ab34-aa954b62f390 could not be found. Jul 01 04:15:14.127851 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi Jul 01 04:15:14.127851 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 04:15:14.127851 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi Jul 01 04:15:14.127851 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 04:15:14.127851 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 04:15:14.127851 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 04:15:14.127851 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 04:15:14.127851 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 04:15:14.127851 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 04:15:14.129118 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 04:15:14.129118 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 04:15:14.129118 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 04:15:14.129118 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 04:15:14.129118 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 04:15:14.129118 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 04:15:14.129118 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 04:15:14.129118 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2e5d1edc-dbae-41dd-ab34-aa954b62f390 could not be found. Jul 01 04:15:14.129118 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi Jul 01 04:15:14.129118 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 04:15:14.129118 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi Jul 01 04:15:14.129118 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 04:15:14.129118 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 04:15:14.129118 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 04:15:14.129118 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 04:15:14.129118 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 04:15:14.129118 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2e5d1edc-dbae-41dd-ab34-aa954b62f390 could not be found. Jul 01 04:15:14.129118 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi Jul 01 04:15:14.130239 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-5cb3c260-51ee-4885-95ee-3a7db0f169c9 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Returning 404 to user: Instance 2e5d1edc-dbae-41dd-ab34-aa954b62f390 could not be found. {{(pid=118711) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 04:15:14.130239 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-5cb3c260-51ee-4885-95ee-3a7db0f169c9 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] 10.222.0.20 "GET /compute/v2.1/servers/2e5d1edc-dbae-41dd-ab34-aa954b62f390" status: 404 len: 111 microversion: 2.1 time: 0.030714 Jul 01 04:15:14.130239 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 451/909] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:15:14 2022] GET /compute/v2.1/servers/2e5d1edc-dbae-41dd-ab34-aa954b62f390 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 04:15:14.135626 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-090ca041-612d-412a-aeef-b2fb0c2d6b85 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Calling method '.version_select at 0x7f99a060b3a0>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:15:14.206360 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-090ca041-612d-412a-aeef-b2fb0c2d6b85 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1836350763" status: 202 len: 0 microversion: 2.1 time: 0.074438 Jul 01 04:15:14.208833 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 459/910] 10.222.0.20 () {58 vars in 1220 bytes} [Fri Jul 1 04:15:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1836350763 => generated 0 bytes in 76 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 04:15:14.530580 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-0dc36104-710d-45df-9256-e80022fef15c tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:15:14.531601 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-0dc36104-710d-45df-9256-e80022fef15c tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] [instance: c2b0a742-21ea-4db3-bbe6-f261c65d7db6] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:15:14.537787 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-0dc36104-710d-45df-9256-e80022fef15c tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:15:14.538544 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-0dc36104-710d-45df-9256-e80022fef15c tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:15:14.539369 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-0dc36104-710d-45df-9256-e80022fef15c tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:15:14.539814 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-0dc36104-710d-45df-9256-e80022fef15c tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:15:14.570858 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-0dc36104-710d-45df-9256-e80022fef15c tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] 10.222.0.20 "GET /compute/v2.1/servers/c2b0a742-21ea-4db3-bbe6-f261c65d7db6/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044466 Jul 01 04:15:14.571448 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 452/911] 10.222.0.20 () {58 vars in 1301 bytes} [Fri Jul 1 04:15:14 2022] GET /compute/v2.1/servers/c2b0a742-21ea-4db3-bbe6-f261c65d7db6/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 01 04:15:14.631107 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-294ba507-5d15-4693-a25f-151e271f7139 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:15:14.631638 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-294ba507-5d15-4693-a25f-151e271f7139 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] [instance: c2b0a742-21ea-4db3-bbe6-f261c65d7db6] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:15:14.637792 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-294ba507-5d15-4693-a25f-151e271f7139 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:15:14.638253 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-294ba507-5d15-4693-a25f-151e271f7139 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:15:14.639032 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-294ba507-5d15-4693-a25f-151e271f7139 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:15:14.640083 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-294ba507-5d15-4693-a25f-151e271f7139 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:15:14.665149 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-294ba507-5d15-4693-a25f-151e271f7139 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] [instance: c2b0a742-21ea-4db3-bbe6-f261c65d7db6] Going to try to terminate instance {{(pid=118712) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 01 04:15:14.924862 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-294ba507-5d15-4693-a25f-151e271f7139 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] 10.222.0.20 "DELETE /compute/v2.1/servers/c2b0a742-21ea-4db3-bbe6-f261c65d7db6" status: 204 len: 0 microversion: 2.1 time: 0.297407 Jul 01 04:15:14.925428 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 460/912] 10.222.0.20 () {58 vars in 1238 bytes} [Fri Jul 1 04:15:14 2022] DELETE /compute/v2.1/servers/c2b0a742-21ea-4db3-bbe6-f261c65d7db6 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 01 04:15:14.933649 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-22ba7563-22d8-433a-9188-cc56c9feaf7e tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:15:14.934346 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-22ba7563-22d8-433a-9188-cc56c9feaf7e tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] [instance: c2b0a742-21ea-4db3-bbe6-f261c65d7db6] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:15:14.943201 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-22ba7563-22d8-433a-9188-cc56c9feaf7e tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:15:14.943679 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-22ba7563-22d8-433a-9188-cc56c9feaf7e tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:15:14.944504 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-22ba7563-22d8-433a-9188-cc56c9feaf7e tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:15:14.944941 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-22ba7563-22d8-433a-9188-cc56c9feaf7e tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:15:15.012103 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-4b65ea8e-f685-46b7-8a37-7baece90d9a5 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Action: 'create', calling method: .version_select at 0x7f99a060b550>, body: {"keypair": {"name": "tempest-keypair-683956672", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAm138sHvnqRWTZN/TavSJV3q0KJ6LnhV+dEYxs7TFb3KSto9rF/8/z/ceD7qEwtXW7lQ7i1DhVfRZCUCwYGMuC4rK+rgiUqIXFcaTLsG/tVolvG/NhBpL2gMhEw5ePteg=="}} {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 04:15:15.026407 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.quota [None req-4b65ea8e-f685-46b7-8a37-7baece90d9a5 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Getting quotas for project 9614129d1e864c3ea288aaac8387c5d1. Resources: {'key_pairs'} {{(pid=118712) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 04:15:15.030570 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.quota [None req-4b65ea8e-f685-46b7-8a37-7baece90d9a5 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Getting quotas for user 73d76a988462431fa6bb03dca64463a4 and project 9614129d1e864c3ea288aaac8387c5d1. Resources: {'key_pairs'} {{(pid=118712) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 04:15:15.078696 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-22ba7563-22d8-433a-9188-cc56c9feaf7e tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac71714265342098d2487a701a6c364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f76a684261dd49f68a42a4e157355f37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:15:15.086307 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-22ba7563-22d8-433a-9188-cc56c9feaf7e tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] 10.222.0.20 "GET /compute/v2.1/servers/c2b0a742-21ea-4db3-bbe6-f261c65d7db6" status: 200 len: 1681 microversion: 2.1 time: 0.156497 Jul 01 04:15:15.087077 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 453/913] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:15:14 2022] GET /compute/v2.1/servers/c2b0a742-21ea-4db3-bbe6-f261c65d7db6 => generated 1681 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:15:15.127005 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-4b65ea8e-f685-46b7-8a37-7baece90d9a5 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.120013 Jul 01 04:15:15.128066 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 461/914] 10.222.0.20 () {60 vars in 1158 bytes} [Fri Jul 1 04:15:15 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 04:15:16.104296 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-0d281b9a-b218-4950-b812-669b24b8e175 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:15:16.104911 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-0d281b9a-b218-4950-b812-669b24b8e175 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] [instance: c2b0a742-21ea-4db3-bbe6-f261c65d7db6] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:15:16.111702 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-0d281b9a-b218-4950-b812-669b24b8e175 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:15:16.112147 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-0d281b9a-b218-4950-b812-669b24b8e175 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:15:16.112904 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-0d281b9a-b218-4950-b812-669b24b8e175 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:15:16.113357 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-0d281b9a-b218-4950-b812-669b24b8e175 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:15:16.244223 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-0d281b9a-b218-4950-b812-669b24b8e175 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac71714265342098d2487a701a6c364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f76a684261dd49f68a42a4e157355f37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:15:16.252540 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-0d281b9a-b218-4950-b812-669b24b8e175 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] 10.222.0.20 "GET /compute/v2.1/servers/c2b0a742-21ea-4db3-bbe6-f261c65d7db6" status: 200 len: 1681 microversion: 2.1 time: 0.152027 Jul 01 04:15:16.253276 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 454/915] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:15:16 2022] GET /compute/v2.1/servers/c2b0a742-21ea-4db3-bbe6-f261c65d7db6 => generated 1681 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:15:17.272516 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-4bd8fc60-db39-4fdd-a677-b22864b21f26 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:15:17.273462 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-4bd8fc60-db39-4fdd-a677-b22864b21f26 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] [instance: c2b0a742-21ea-4db3-bbe6-f261c65d7db6] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:15:17.281969 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-4bd8fc60-db39-4fdd-a677-b22864b21f26 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:15:17.282480 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-4bd8fc60-db39-4fdd-a677-b22864b21f26 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:15:17.283440 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-4bd8fc60-db39-4fdd-a677-b22864b21f26 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:15:17.283956 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-4bd8fc60-db39-4fdd-a677-b22864b21f26 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:15:17.363889 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-4bd8fc60-db39-4fdd-a677-b22864b21f26 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac71714265342098d2487a701a6c364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f76a684261dd49f68a42a4e157355f37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:15:17.375938 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-4bd8fc60-db39-4fdd-a677-b22864b21f26 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] 10.222.0.20 "GET /compute/v2.1/servers/c2b0a742-21ea-4db3-bbe6-f261c65d7db6" status: 200 len: 1614 microversion: 2.1 time: 0.109069 Jul 01 04:15:17.377659 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 462/916] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:15:17 2022] GET /compute/v2.1/servers/c2b0a742-21ea-4db3-bbe6-f261c65d7db6 => generated 1614 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:15:17.404143 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [req-99619704-a37c-4200-a8ce-52ef8076e4dc req-f808c3d8-1465-4aac-bcb5-6db3f8659909 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c2b0a742-21ea-4db3-bbe6-f261c65d7db6", "name": "network-vif-deleted", "tag": "e85356b9-8a4c-49b0-95bc-3d8ba8e63319"}]} {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 04:15:17.413598 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [req-99619704-a37c-4200-a8ce-52ef8076e4dc req-f808c3d8-1465-4aac-bcb5-6db3f8659909 service nova] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:15:17.414207 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [req-99619704-a37c-4200-a8ce-52ef8076e4dc req-f808c3d8-1465-4aac-bcb5-6db3f8659909 service nova] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:15:17.426241 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.compute.server_external_events [req-99619704-a37c-4200-a8ce-52ef8076e4dc req-f808c3d8-1465-4aac-bcb5-6db3f8659909 service nova] Creating event network-vif-deleted:e85356b9-8a4c-49b0-95bc-3d8ba8e63319 for instance c2b0a742-21ea-4db3-bbe6-f261c65d7db6 on hv-cinder-84684 Jul 01 04:15:17.431362 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [req-99619704-a37c-4200-a8ce-52ef8076e4dc req-f808c3d8-1465-4aac-bcb5-6db3f8659909 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030827 Jul 01 04:15:17.432522 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 455/917] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Jul 1 04:15:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 04:15:17.896567 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-b4f6bedb-0c3f-44bc-9950-f3f0b8f64923 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-937035272", "imageRef": "66f9f4ba-339c-4967-8857-d65299a66629", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c429d9e7-af70-440a-8720-43fe9c7d6353"}], "security_groups": [{"name": "tempest-securitygroup--2063250545"}], "key_name": "tempest-keypair-683956672", "user_data": "}} {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 04:15:18.000596 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.network.neutron [None req-b4f6bedb-0c3f-44bc-9950-f3f0b8f64923 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] validate_networks() for [('c429d9e7-af70-440a-8720-43fe9c7d6353', None, None, None, None, None)] {{(pid=118712) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 01 04:15:18.394557 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-f1844464-bd90-477f-b2ab-aa76c5c67370 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:15:18.395169 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-f1844464-bd90-477f-b2ab-aa76c5c67370 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] [instance: c2b0a742-21ea-4db3-bbe6-f261c65d7db6] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:15:18.402347 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-f1844464-bd90-477f-b2ab-aa76c5c67370 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:15:18.402798 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-f1844464-bd90-477f-b2ab-aa76c5c67370 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:15:18.404156 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-f1844464-bd90-477f-b2ab-aa76c5c67370 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:15:18.404809 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-f1844464-bd90-477f-b2ab-aa76c5c67370 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:15:18.410784 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.virt.hardware [None req-b4f6bedb-0c3f-44bc-9950-f3f0b8f64923 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Flavor limits 0:0:0 {{(pid=118712) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 01 04:15:18.411805 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.virt.hardware [None req-b4f6bedb-0c3f-44bc-9950-f3f0b8f64923 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Image limits 0:0:0 {{(pid=118712) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 01 04:15:18.412330 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.virt.hardware [None req-b4f6bedb-0c3f-44bc-9950-f3f0b8f64923 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Flavor pref 0:0:0 {{(pid=118712) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 01 04:15:18.412700 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.virt.hardware [None req-b4f6bedb-0c3f-44bc-9950-f3f0b8f64923 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Image pref 0:0:0 {{(pid=118712) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 01 04:15:18.413117 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.virt.hardware [None req-b4f6bedb-0c3f-44bc-9950-f3f0b8f64923 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118712) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 01 04:15:18.422188 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-b4f6bedb-0c3f-44bc-9950-f3f0b8f64923 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:15:18.423129 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-b4f6bedb-0c3f-44bc-9950-f3f0b8f64923 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:15:18.424069 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-b4f6bedb-0c3f-44bc-9950-f3f0b8f64923 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:15:18.424576 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-b4f6bedb-0c3f-44bc-9950-f3f0b8f64923 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:15:18.440543 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-f1844464-bd90-477f-b2ab-aa76c5c67370 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:15:18.441270 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-f1844464-bd90-477f-b2ab-aa76c5c67370 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:15:18.441725 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.objects.instance [None req-f1844464-bd90-477f-b2ab-aa76c5c67370 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lazy-loading 'fault' on Instance uuid c2b0a742-21ea-4db3-bbe6-f261c65d7db6 {{(pid=118711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 04:15:18.442759 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.quota [None req-b4f6bedb-0c3f-44bc-9950-f3f0b8f64923 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Getting quotas for project 9614129d1e864c3ea288aaac8387c5d1. Resources: {'ram', 'cores', 'instances'} {{(pid=118712) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 04:15:18.447478 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.quota [None req-b4f6bedb-0c3f-44bc-9950-f3f0b8f64923 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Getting quotas for user 73d76a988462431fa6bb03dca64463a4 and project 9614129d1e864c3ea288aaac8387c5d1. Resources: {'ram', 'cores', 'instances'} {{(pid=118712) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 04:15:18.459959 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-b4f6bedb-0c3f-44bc-9950-f3f0b8f64923 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Going to run 1 instances... {{(pid=118712) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 01 04:15:18.462357 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-b4f6bedb-0c3f-44bc-9950-f3f0b8f64923 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] [instance: 20264c61-166b-4dce-9121-d530cedf677f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='66f9f4ba-339c-4967-8857-d65299a66629',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118712) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 01 04:15:18.489630 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-f1844464-bd90-477f-b2ab-aa76c5c67370 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac71714265342098d2487a701a6c364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f76a684261dd49f68a42a4e157355f37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:15:18.496598 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-f1844464-bd90-477f-b2ab-aa76c5c67370 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] 10.222.0.20 "GET /compute/v2.1/servers/c2b0a742-21ea-4db3-bbe6-f261c65d7db6" status: 200 len: 1332 microversion: 2.1 time: 0.107139 Jul 01 04:15:18.497165 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 456/918] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:15:18 2022] GET /compute/v2.1/servers/c2b0a742-21ea-4db3-bbe6-f261c65d7db6 => generated 1332 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 04:15:18.676014 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-b4f6bedb-0c3f-44bc-9950-f3f0b8f64923 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.783455 Jul 01 04:15:18.676594 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 463/919] 10.222.0.20 () {60 vars in 1146 bytes} [Fri Jul 1 04:15:17 2022] POST /compute/v2.1/servers => generated 402 bytes in 785 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 01 04:15:18.686628 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-252f9d30-3e6a-4204-8fee-b093e789ceb5 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:15:18.687299 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-252f9d30-3e6a-4204-8fee-b093e789ceb5 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] [instance: 20264c61-166b-4dce-9121-d530cedf677f] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:15:18.745569 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-252f9d30-3e6a-4204-8fee-b093e789ceb5 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73d76a988462431fa6bb03dca64463a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9614129d1e864c3ea288aaac8387c5d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:15:18.752140 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-252f9d30-3e6a-4204-8fee-b093e789ceb5 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] 10.222.0.20 "GET /compute/v2.1/servers/20264c61-166b-4dce-9121-d530cedf677f" status: 200 len: 1236 microversion: 2.1 time: 0.069320 Jul 01 04:15:18.752713 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 457/920] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:15:18 2022] GET /compute/v2.1/servers/20264c61-166b-4dce-9121-d530cedf677f => generated 1236 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:15:19.514275 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-5991b08a-ae0e-4d7e-8425-a131260a17e2 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:15:19.514931 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-5991b08a-ae0e-4d7e-8425-a131260a17e2 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] [instance: c2b0a742-21ea-4db3-bbe6-f261c65d7db6] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:15:19.522417 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-5991b08a-ae0e-4d7e-8425-a131260a17e2 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:15:19.522875 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-5991b08a-ae0e-4d7e-8425-a131260a17e2 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:15:19.523684 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-5991b08a-ae0e-4d7e-8425-a131260a17e2 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:15:19.524123 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-5991b08a-ae0e-4d7e-8425-a131260a17e2 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:15:19.537617 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.wsgi [None req-5991b08a-ae0e-4d7e-8425-a131260a17e2 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] HTTP exception thrown: Instance c2b0a742-21ea-4db3-bbe6-f261c65d7db6 could not be found. Jul 01 04:15:19.539305 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-5991b08a-ae0e-4d7e-8425-a131260a17e2 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Request method failure captured: Jul 01 04:15:19.539305 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: request: GET /compute/v2.1/servers/c2b0a742-21ea-4db3-bbe6-f261c65d7db6 HTTP/1.1 Jul 01 04:15:19.539305 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: Accept: application/json Jul 01 04:15:19.539305 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: Accept-Encoding: identity Jul 01 04:15:19.539305 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: Connection: close Jul 01 04:15:19.539305 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: Content-Length: 0 Jul 01 04:15:19.539305 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: Content-Type: application/json Jul 01 04:15:19.539305 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: Host: 10.222.0.20 Jul 01 04:15:19.539305 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: Openstack-System-Scope: None Jul 01 04:15:19.539305 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: User-Agent: python-urllib3/1.26.9 Jul 01 04:15:19.539305 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Auth-Token: gAAAAABivnO_2SHspn5040vH8P4vp6P_nHqsfbY2b8BaTxMU37E-Nm1nW3UiPrXBDY7TPTOcTyJxuvdXyhrWNFcAJgF991L1LL3g9HBHqdiHQSEKxKFPESilMhAE3M7664WhTBceQb5njdTfXXYCgJ_rjpGbTLpsJzn6ZaZQDIGWFCb9NOvUG5w Jul 01 04:15:19.539305 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Domain-Id: None Jul 01 04:15:19.539305 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Domain-Name: None Jul 01 04:15:19.539305 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Identity-Status: Confirmed Jul 01 04:15:19.539305 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Is-Admin-Project: True Jul 01 04:15:19.539305 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Project-Domain-Id: default Jul 01 04:15:19.539305 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Project-Domain-Name: Default Jul 01 04:15:19.539305 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Project-Id: f76a684261dd49f68a42a4e157355f37 Jul 01 04:15:19.539305 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Project-Name: tempest-AttachVolumeNegativeTest-1321993683 Jul 01 04:15:19.539305 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Role: reader,member Jul 01 04:15:19.539305 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Roles: reader,member Jul 01 04:15:19.541084 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/f76a684261dd49f68a42a4e157355f37"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_f76a684261dd49f68a42a4e157355f37", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f76a684261dd49f68a42a4e157355f37"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f76a684261dd49f68a42a4e157355f37"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}] Jul 01 04:15:19.541084 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Tenant: tempest-AttachVolumeNegativeTest-1321993683 Jul 01 04:15:19.541084 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Tenant-Id: f76a684261dd49f68a42a4e157355f37 Jul 01 04:15:19.541084 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1321993683 Jul 01 04:15:19.541084 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-User: tempest-AttachVolumeNegativeTest-1321993683-project Jul 01 04:15:19.541084 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-User-Domain-Id: default Jul 01 04:15:19.541084 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-User-Domain-Name: Default Jul 01 04:15:19.541084 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-User-Id: 4ac71714265342098d2487a701a6c364 Jul 01 04:15:19.541084 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-User-Name: tempest-AttachVolumeNegativeTest-1321993683-project Jul 01 04:15:19.541084 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: method: > Jul 01 04:15:19.541084 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: exception: Instance c2b0a742-21ea-4db3-bbe6-f261c65d7db6 could not be found. Jul 01 04:15:19.541084 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: action_args: {'id': 'c2b0a742-21ea-4db3-bbe6-f261c65d7db6'} Jul 01 04:15:19.542346 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 04:15:19.542346 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 04:15:19.542346 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 04:15:19.542346 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 04:15:19.542346 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 04:15:19.542346 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 04:15:19.542346 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 04:15:19.542346 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 04:15:19.542346 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 04:15:19.542346 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 04:15:19.542346 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c2b0a742-21ea-4db3-bbe6-f261c65d7db6 could not be found. Jul 01 04:15:19.542346 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi Jul 01 04:15:19.542346 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 04:15:19.542346 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi Jul 01 04:15:19.542346 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 04:15:19.542346 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 04:15:19.542346 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 04:15:19.542346 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 04:15:19.542346 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 04:15:19.542346 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 04:15:19.544442 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 04:15:19.544442 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 04:15:19.544442 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 04:15:19.544442 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 04:15:19.544442 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 04:15:19.544442 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 04:15:19.544442 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 04:15:19.544442 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c2b0a742-21ea-4db3-bbe6-f261c65d7db6 could not be found. Jul 01 04:15:19.544442 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi Jul 01 04:15:19.544442 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 04:15:19.544442 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi Jul 01 04:15:19.544442 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 04:15:19.544442 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 04:15:19.544442 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 04:15:19.544442 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 04:15:19.544442 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 04:15:19.544442 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c2b0a742-21ea-4db3-bbe6-f261c65d7db6 could not be found. Jul 01 04:15:19.544442 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi Jul 01 04:15:19.545707 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-5991b08a-ae0e-4d7e-8425-a131260a17e2 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Returning 404 to user: Instance c2b0a742-21ea-4db3-bbe6-f261c65d7db6 could not be found. {{(pid=118712) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 04:15:19.545707 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-5991b08a-ae0e-4d7e-8425-a131260a17e2 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] 10.222.0.20 "GET /compute/v2.1/servers/c2b0a742-21ea-4db3-bbe6-f261c65d7db6" status: 404 len: 111 microversion: 2.1 time: 0.030699 Jul 01 04:15:19.545707 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 464/921] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:15:19 2022] GET /compute/v2.1/servers/c2b0a742-21ea-4db3-bbe6-f261c65d7db6 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 04:15:19.551969 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-a69c072f-4f92-4d7c-9640-602042286d16 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Calling method '.version_select at 0x7f99a075f670>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:15:19.645868 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-a69c072f-4f92-4d7c-9640-602042286d16 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1858610472" status: 202 len: 0 microversion: 2.1 time: 0.097648 Jul 01 04:15:19.646898 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 458/922] 10.222.0.20 () {58 vars in 1220 bytes} [Fri Jul 1 04:15:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1858610472 => generated 0 bytes in 99 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 04:15:19.769240 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-641bd1e2-756c-4fa6-b55b-0a9205ac9f1a tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:15:19.769793 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-641bd1e2-756c-4fa6-b55b-0a9205ac9f1a tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] [instance: 20264c61-166b-4dce-9121-d530cedf677f] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:15:19.776108 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-641bd1e2-756c-4fa6-b55b-0a9205ac9f1a tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:15:19.776876 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-641bd1e2-756c-4fa6-b55b-0a9205ac9f1a tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:15:19.777735 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-641bd1e2-756c-4fa6-b55b-0a9205ac9f1a tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:15:19.778253 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-641bd1e2-756c-4fa6-b55b-0a9205ac9f1a tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:15:19.841254 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-641bd1e2-756c-4fa6-b55b-0a9205ac9f1a tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73d76a988462431fa6bb03dca64463a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9614129d1e864c3ea288aaac8387c5d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:15:19.849394 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-641bd1e2-756c-4fa6-b55b-0a9205ac9f1a tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] 10.222.0.20 "GET /compute/v2.1/servers/20264c61-166b-4dce-9121-d530cedf677f" status: 200 len: 1232 microversion: 2.1 time: 0.084409 Jul 01 04:15:19.849967 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 465/923] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:15:19 2022] GET /compute/v2.1/servers/20264c61-166b-4dce-9121-d530cedf677f => generated 1232 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:15:20.867780 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-1109e4db-27f4-4cbc-b044-580457935a2e tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:15:20.868332 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-1109e4db-27f4-4cbc-b044-580457935a2e tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] [instance: 20264c61-166b-4dce-9121-d530cedf677f] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:15:20.875939 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-1109e4db-27f4-4cbc-b044-580457935a2e tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:15:20.876446 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-1109e4db-27f4-4cbc-b044-580457935a2e tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:15:20.877229 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-1109e4db-27f4-4cbc-b044-580457935a2e tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:15:20.877676 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-1109e4db-27f4-4cbc-b044-580457935a2e tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:15:20.951702 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-1109e4db-27f4-4cbc-b044-580457935a2e tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73d76a988462431fa6bb03dca64463a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9614129d1e864c3ea288aaac8387c5d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:15:20.959238 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-1109e4db-27f4-4cbc-b044-580457935a2e tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] 10.222.0.20 "GET /compute/v2.1/servers/20264c61-166b-4dce-9121-d530cedf677f" status: 200 len: 1306 microversion: 2.1 time: 0.096425 Jul 01 04:15:20.959887 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 459/924] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:15:20 2022] GET /compute/v2.1/servers/20264c61-166b-4dce-9121-d530cedf677f => generated 1306 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:15:21.687117 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-a81d1996-e5ec-41ab-bb05-022b698e8c3e tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:15:21.687672 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-a81d1996-e5ec-41ab-bb05-022b698e8c3e tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] [instance: c2b0a742-21ea-4db3-bbe6-f261c65d7db6] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:15:21.694468 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-a81d1996-e5ec-41ab-bb05-022b698e8c3e tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:15:21.694933 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-a81d1996-e5ec-41ab-bb05-022b698e8c3e tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:15:21.695740 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-a81d1996-e5ec-41ab-bb05-022b698e8c3e tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:15:21.696357 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-a81d1996-e5ec-41ab-bb05-022b698e8c3e tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:15:21.713935 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.wsgi [None req-a81d1996-e5ec-41ab-bb05-022b698e8c3e tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] HTTP exception thrown: Instance c2b0a742-21ea-4db3-bbe6-f261c65d7db6 could not be found. Jul 01 04:15:21.715544 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-a81d1996-e5ec-41ab-bb05-022b698e8c3e tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Request method failure captured: Jul 01 04:15:21.715544 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: request: DELETE /compute/v2.1/servers/c2b0a742-21ea-4db3-bbe6-f261c65d7db6 HTTP/1.1 Jul 01 04:15:21.715544 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: Accept: application/json Jul 01 04:15:21.715544 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: Accept-Encoding: identity Jul 01 04:15:21.715544 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: Connection: close Jul 01 04:15:21.715544 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: Content-Length: 0 Jul 01 04:15:21.715544 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: Content-Type: application/json Jul 01 04:15:21.715544 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: Host: 10.222.0.20 Jul 01 04:15:21.715544 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: Openstack-System-Scope: None Jul 01 04:15:21.715544 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: User-Agent: python-urllib3/1.26.9 Jul 01 04:15:21.715544 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Auth-Token: gAAAAABivnO_2SHspn5040vH8P4vp6P_nHqsfbY2b8BaTxMU37E-Nm1nW3UiPrXBDY7TPTOcTyJxuvdXyhrWNFcAJgF991L1LL3g9HBHqdiHQSEKxKFPESilMhAE3M7664WhTBceQb5njdTfXXYCgJ_rjpGbTLpsJzn6ZaZQDIGWFCb9NOvUG5w Jul 01 04:15:21.715544 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Domain-Id: None Jul 01 04:15:21.715544 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Domain-Name: None Jul 01 04:15:21.715544 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Identity-Status: Confirmed Jul 01 04:15:21.715544 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Is-Admin-Project: True Jul 01 04:15:21.715544 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Project-Domain-Id: default Jul 01 04:15:21.715544 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Project-Domain-Name: Default Jul 01 04:15:21.715544 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Project-Id: f76a684261dd49f68a42a4e157355f37 Jul 01 04:15:21.715544 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Project-Name: tempest-AttachVolumeNegativeTest-1321993683 Jul 01 04:15:21.715544 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Role: reader,member Jul 01 04:15:21.715544 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Roles: reader,member Jul 01 04:15:21.717206 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/f76a684261dd49f68a42a4e157355f37"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_f76a684261dd49f68a42a4e157355f37", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f76a684261dd49f68a42a4e157355f37"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f76a684261dd49f68a42a4e157355f37"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}] Jul 01 04:15:21.717206 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Tenant: tempest-AttachVolumeNegativeTest-1321993683 Jul 01 04:15:21.717206 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Tenant-Id: f76a684261dd49f68a42a4e157355f37 Jul 01 04:15:21.717206 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1321993683 Jul 01 04:15:21.717206 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-User: tempest-AttachVolumeNegativeTest-1321993683-project Jul 01 04:15:21.717206 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-User-Domain-Id: default Jul 01 04:15:21.717206 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-User-Domain-Name: Default Jul 01 04:15:21.717206 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-User-Id: 4ac71714265342098d2487a701a6c364 Jul 01 04:15:21.717206 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-User-Name: tempest-AttachVolumeNegativeTest-1321993683-project Jul 01 04:15:21.717206 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: method: > Jul 01 04:15:21.717206 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: exception: Instance c2b0a742-21ea-4db3-bbe6-f261c65d7db6 could not be found. Jul 01 04:15:21.717206 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: action_args: {'id': 'c2b0a742-21ea-4db3-bbe6-f261c65d7db6'} Jul 01 04:15:21.718078 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 04:15:21.718078 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 04:15:21.718078 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 04:15:21.718078 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 04:15:21.718078 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 04:15:21.718078 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 04:15:21.718078 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 04:15:21.718078 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 04:15:21.718078 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 04:15:21.718078 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 04:15:21.718078 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c2b0a742-21ea-4db3-bbe6-f261c65d7db6 could not be found. Jul 01 04:15:21.718078 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi Jul 01 04:15:21.718078 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 04:15:21.718078 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi Jul 01 04:15:21.718078 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 04:15:21.718078 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 04:15:21.718078 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 04:15:21.718078 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 04:15:21.718078 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 04:15:21.718078 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 04:15:21.720215 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 04:15:21.720215 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 01 04:15:21.720215 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 01 04:15:21.720215 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 01 04:15:21.720215 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 01 04:15:21.720215 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 04:15:21.720215 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 04:15:21.720215 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 04:15:21.720215 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 04:15:21.720215 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c2b0a742-21ea-4db3-bbe6-f261c65d7db6 could not be found. Jul 01 04:15:21.720215 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi Jul 01 04:15:21.720215 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 04:15:21.720215 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi Jul 01 04:15:21.720215 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 04:15:21.720215 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 04:15:21.720215 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 04:15:21.720215 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 04:15:21.720215 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 04:15:21.720215 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c2b0a742-21ea-4db3-bbe6-f261c65d7db6 could not be found. Jul 01 04:15:21.720215 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi Jul 01 04:15:21.721668 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-a81d1996-e5ec-41ab-bb05-022b698e8c3e tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Returning 404 to user: Instance c2b0a742-21ea-4db3-bbe6-f261c65d7db6 could not be found. {{(pid=118712) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 04:15:21.721668 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-a81d1996-e5ec-41ab-bb05-022b698e8c3e tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] 10.222.0.20 "DELETE /compute/v2.1/servers/c2b0a742-21ea-4db3-bbe6-f261c65d7db6" status: 404 len: 111 microversion: 2.1 time: 0.034554 Jul 01 04:15:21.721668 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 466/925] 10.222.0.20 () {58 vars in 1238 bytes} [Fri Jul 1 04:15:21 2022] DELETE /compute/v2.1/servers/c2b0a742-21ea-4db3-bbe6-f261c65d7db6 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 04:15:21.726730 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-ca1adcde-edc7-46ab-941f-597ed3990372 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:15:21.727383 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-ca1adcde-edc7-46ab-941f-597ed3990372 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] [instance: c2b0a742-21ea-4db3-bbe6-f261c65d7db6] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:15:21.733302 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-ca1adcde-edc7-46ab-941f-597ed3990372 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:15:21.733753 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-ca1adcde-edc7-46ab-941f-597ed3990372 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:15:21.734529 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-ca1adcde-edc7-46ab-941f-597ed3990372 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:15:21.734967 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-ca1adcde-edc7-46ab-941f-597ed3990372 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:15:21.750058 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.wsgi [None req-ca1adcde-edc7-46ab-941f-597ed3990372 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] HTTP exception thrown: Instance c2b0a742-21ea-4db3-bbe6-f261c65d7db6 could not be found. Jul 01 04:15:21.751746 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-ca1adcde-edc7-46ab-941f-597ed3990372 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Request method failure captured: Jul 01 04:15:21.751746 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: request: GET /compute/v2.1/servers/c2b0a742-21ea-4db3-bbe6-f261c65d7db6 HTTP/1.1 Jul 01 04:15:21.751746 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: Accept: application/json Jul 01 04:15:21.751746 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: Accept-Encoding: identity Jul 01 04:15:21.751746 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: Connection: close Jul 01 04:15:21.751746 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: Content-Length: 0 Jul 01 04:15:21.751746 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: Content-Type: application/json Jul 01 04:15:21.751746 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: Host: 10.222.0.20 Jul 01 04:15:21.751746 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: Openstack-System-Scope: None Jul 01 04:15:21.751746 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: User-Agent: python-urllib3/1.26.9 Jul 01 04:15:21.751746 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-Auth-Token: gAAAAABivnO_2SHspn5040vH8P4vp6P_nHqsfbY2b8BaTxMU37E-Nm1nW3UiPrXBDY7TPTOcTyJxuvdXyhrWNFcAJgF991L1LL3g9HBHqdiHQSEKxKFPESilMhAE3M7664WhTBceQb5njdTfXXYCgJ_rjpGbTLpsJzn6ZaZQDIGWFCb9NOvUG5w Jul 01 04:15:21.751746 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-Domain-Id: None Jul 01 04:15:21.751746 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-Domain-Name: None Jul 01 04:15:21.751746 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-Identity-Status: Confirmed Jul 01 04:15:21.751746 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-Is-Admin-Project: True Jul 01 04:15:21.751746 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-Project-Domain-Id: default Jul 01 04:15:21.751746 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-Project-Domain-Name: Default Jul 01 04:15:21.751746 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-Project-Id: f76a684261dd49f68a42a4e157355f37 Jul 01 04:15:21.751746 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-Project-Name: tempest-AttachVolumeNegativeTest-1321993683 Jul 01 04:15:21.751746 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-Role: reader,member Jul 01 04:15:21.751746 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-Roles: reader,member Jul 01 04:15:21.753411 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/f76a684261dd49f68a42a4e157355f37"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_f76a684261dd49f68a42a4e157355f37", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f76a684261dd49f68a42a4e157355f37"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f76a684261dd49f68a42a4e157355f37"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}] Jul 01 04:15:21.753411 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-Tenant: tempest-AttachVolumeNegativeTest-1321993683 Jul 01 04:15:21.753411 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-Tenant-Id: f76a684261dd49f68a42a4e157355f37 Jul 01 04:15:21.753411 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1321993683 Jul 01 04:15:21.753411 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-User: tempest-AttachVolumeNegativeTest-1321993683-project Jul 01 04:15:21.753411 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-User-Domain-Id: default Jul 01 04:15:21.753411 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-User-Domain-Name: Default Jul 01 04:15:21.753411 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-User-Id: 4ac71714265342098d2487a701a6c364 Jul 01 04:15:21.753411 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-User-Name: tempest-AttachVolumeNegativeTest-1321993683-project Jul 01 04:15:21.753411 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: method: > Jul 01 04:15:21.753411 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: exception: Instance c2b0a742-21ea-4db3-bbe6-f261c65d7db6 could not be found. Jul 01 04:15:21.753411 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: action_args: {'id': 'c2b0a742-21ea-4db3-bbe6-f261c65d7db6'} Jul 01 04:15:21.754206 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 04:15:21.754206 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 04:15:21.754206 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 04:15:21.754206 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 04:15:21.754206 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 04:15:21.754206 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 04:15:21.754206 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 04:15:21.754206 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 04:15:21.754206 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 04:15:21.754206 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 04:15:21.754206 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c2b0a742-21ea-4db3-bbe6-f261c65d7db6 could not be found. Jul 01 04:15:21.754206 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi Jul 01 04:15:21.754206 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 04:15:21.754206 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi Jul 01 04:15:21.754206 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 04:15:21.754206 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 04:15:21.754206 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 04:15:21.754206 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 04:15:21.754206 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 04:15:21.754206 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 04:15:21.755487 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 04:15:21.755487 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 04:15:21.755487 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 04:15:21.755487 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 04:15:21.755487 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 04:15:21.755487 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 04:15:21.755487 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 04:15:21.755487 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c2b0a742-21ea-4db3-bbe6-f261c65d7db6 could not be found. Jul 01 04:15:21.755487 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi Jul 01 04:15:21.755487 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 04:15:21.755487 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi Jul 01 04:15:21.755487 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 04:15:21.755487 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 04:15:21.755487 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 04:15:21.755487 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 04:15:21.755487 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 04:15:21.755487 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c2b0a742-21ea-4db3-bbe6-f261c65d7db6 could not be found. Jul 01 04:15:21.755487 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi Jul 01 04:15:21.756640 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-ca1adcde-edc7-46ab-941f-597ed3990372 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Returning 404 to user: Instance c2b0a742-21ea-4db3-bbe6-f261c65d7db6 could not be found. {{(pid=118711) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 04:15:21.756640 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-ca1adcde-edc7-46ab-941f-597ed3990372 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] 10.222.0.20 "GET /compute/v2.1/servers/c2b0a742-21ea-4db3-bbe6-f261c65d7db6" status: 404 len: 111 microversion: 2.1 time: 0.030692 Jul 01 04:15:21.756640 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 460/926] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:15:21 2022] GET /compute/v2.1/servers/c2b0a742-21ea-4db3-bbe6-f261c65d7db6 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 04:15:21.977006 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-1bd02b9e-9ab1-4a22-b6c0-6ad630e5bd89 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:15:21.977534 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-1bd02b9e-9ab1-4a22-b6c0-6ad630e5bd89 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] [instance: 20264c61-166b-4dce-9121-d530cedf677f] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:15:21.983747 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-1bd02b9e-9ab1-4a22-b6c0-6ad630e5bd89 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:15:21.984226 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-1bd02b9e-9ab1-4a22-b6c0-6ad630e5bd89 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:15:21.985011 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-1bd02b9e-9ab1-4a22-b6c0-6ad630e5bd89 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:15:21.985437 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-1bd02b9e-9ab1-4a22-b6c0-6ad630e5bd89 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:15:22.152130 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-1bd02b9e-9ab1-4a22-b6c0-6ad630e5bd89 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73d76a988462431fa6bb03dca64463a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9614129d1e864c3ea288aaac8387c5d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:15:22.153815 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-1bd02b9e-9ab1-4a22-b6c0-6ad630e5bd89 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] 10.222.0.20 "GET /compute/v2.1/servers/20264c61-166b-4dce-9121-d530cedf677f" status: 200 len: 1362 microversion: 2.1 time: 0.180813 Jul 01 04:15:22.163972 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 467/927] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:15:21 2022] GET /compute/v2.1/servers/20264c61-166b-4dce-9121-d530cedf677f => generated 1362 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:15:22.321667 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [req-ef69c2e4-35f2-4ff5-9e04-ba7cf1b0288d req-28054512-7223-4b16-9027-4b2bfe136222 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "20264c61-166b-4dce-9121-d530cedf677f", "tag": "43920b00-11fc-46a2-8809-9dc05269c7c4"}]} {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 04:15:22.335210 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [req-ef69c2e4-35f2-4ff5-9e04-ba7cf1b0288d req-28054512-7223-4b16-9027-4b2bfe136222 service nova] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:15:22.336526 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [req-ef69c2e4-35f2-4ff5-9e04-ba7cf1b0288d req-28054512-7223-4b16-9027-4b2bfe136222 service nova] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:15:22.349923 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.compute.server_external_events [req-ef69c2e4-35f2-4ff5-9e04-ba7cf1b0288d req-28054512-7223-4b16-9027-4b2bfe136222 service nova] Creating event network-changed:43920b00-11fc-46a2-8809-9dc05269c7c4 for instance 20264c61-166b-4dce-9121-d530cedf677f on hv-cinder-84684 Jul 01 04:15:22.355766 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [req-ef69c2e4-35f2-4ff5-9e04-ba7cf1b0288d req-28054512-7223-4b16-9027-4b2bfe136222 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041551 Jul 01 04:15:22.356443 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 461/928] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Jul 1 04:15:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 04:15:23.162251 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-e3cff15b-bce8-4117-a043-7a3258bf121c tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:15:23.163009 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-e3cff15b-bce8-4117-a043-7a3258bf121c tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] [instance: 0c303914-e7aa-4775-a6ae-b57f31cfe479] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:15:23.169664 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-e3cff15b-bce8-4117-a043-7a3258bf121c tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:15:23.170229 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-e3cff15b-bce8-4117-a043-7a3258bf121c tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:15:23.171106 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-e3cff15b-bce8-4117-a043-7a3258bf121c tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:15:23.171791 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-e3cff15b-bce8-4117-a043-7a3258bf121c tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:15:23.172215 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-1ff5e5f2-f1b8-47da-80dd-4d81f759c2c1 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:15:23.172925 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-1ff5e5f2-f1b8-47da-80dd-4d81f759c2c1 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] [instance: 20264c61-166b-4dce-9121-d530cedf677f] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:15:23.180988 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-1ff5e5f2-f1b8-47da-80dd-4d81f759c2c1 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:15:23.181450 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-1ff5e5f2-f1b8-47da-80dd-4d81f759c2c1 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:15:23.182327 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-1ff5e5f2-f1b8-47da-80dd-4d81f759c2c1 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:15:23.182778 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-1ff5e5f2-f1b8-47da-80dd-4d81f759c2c1 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:15:23.189392 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.wsgi [None req-e3cff15b-bce8-4117-a043-7a3258bf121c tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] HTTP exception thrown: Instance 0c303914-e7aa-4775-a6ae-b57f31cfe479 could not be found. Jul 01 04:15:23.190839 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-e3cff15b-bce8-4117-a043-7a3258bf121c tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Request method failure captured: Jul 01 04:15:23.190839 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: request: DELETE /compute/v2.1/servers/0c303914-e7aa-4775-a6ae-b57f31cfe479 HTTP/1.1 Jul 01 04:15:23.190839 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: Accept: application/json Jul 01 04:15:23.190839 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: Accept-Encoding: identity Jul 01 04:15:23.190839 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: Connection: close Jul 01 04:15:23.190839 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: Content-Length: 0 Jul 01 04:15:23.190839 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: Content-Type: application/json Jul 01 04:15:23.190839 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: Host: 10.222.0.20 Jul 01 04:15:23.190839 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: Openstack-System-Scope: None Jul 01 04:15:23.190839 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: User-Agent: python-urllib3/1.26.9 Jul 01 04:15:23.190839 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Auth-Token: gAAAAABivnO_2SHspn5040vH8P4vp6P_nHqsfbY2b8BaTxMU37E-Nm1nW3UiPrXBDY7TPTOcTyJxuvdXyhrWNFcAJgF991L1LL3g9HBHqdiHQSEKxKFPESilMhAE3M7664WhTBceQb5njdTfXXYCgJ_rjpGbTLpsJzn6ZaZQDIGWFCb9NOvUG5w Jul 01 04:15:23.190839 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Domain-Id: None Jul 01 04:15:23.190839 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Domain-Name: None Jul 01 04:15:23.190839 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Identity-Status: Confirmed Jul 01 04:15:23.190839 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Is-Admin-Project: True Jul 01 04:15:23.190839 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Project-Domain-Id: default Jul 01 04:15:23.190839 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Project-Domain-Name: Default Jul 01 04:15:23.190839 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Project-Id: f76a684261dd49f68a42a4e157355f37 Jul 01 04:15:23.190839 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Project-Name: tempest-AttachVolumeNegativeTest-1321993683 Jul 01 04:15:23.190839 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Role: reader,member Jul 01 04:15:23.190839 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Roles: reader,member Jul 01 04:15:23.192660 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/f76a684261dd49f68a42a4e157355f37"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_f76a684261dd49f68a42a4e157355f37", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f76a684261dd49f68a42a4e157355f37"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f76a684261dd49f68a42a4e157355f37"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}] Jul 01 04:15:23.192660 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Tenant: tempest-AttachVolumeNegativeTest-1321993683 Jul 01 04:15:23.192660 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Tenant-Id: f76a684261dd49f68a42a4e157355f37 Jul 01 04:15:23.192660 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1321993683 Jul 01 04:15:23.192660 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-User: tempest-AttachVolumeNegativeTest-1321993683-project Jul 01 04:15:23.192660 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-User-Domain-Id: default Jul 01 04:15:23.192660 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-User-Domain-Name: Default Jul 01 04:15:23.192660 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-User-Id: 4ac71714265342098d2487a701a6c364 Jul 01 04:15:23.192660 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-User-Name: tempest-AttachVolumeNegativeTest-1321993683-project Jul 01 04:15:23.192660 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: method: > Jul 01 04:15:23.192660 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: exception: Instance 0c303914-e7aa-4775-a6ae-b57f31cfe479 could not be found. Jul 01 04:15:23.192660 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: action_args: {'id': '0c303914-e7aa-4775-a6ae-b57f31cfe479'} Jul 01 04:15:23.193885 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 04:15:23.193885 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 04:15:23.193885 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 04:15:23.193885 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 04:15:23.193885 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 04:15:23.193885 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 04:15:23.193885 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 04:15:23.193885 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 04:15:23.193885 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 04:15:23.193885 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 04:15:23.193885 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0c303914-e7aa-4775-a6ae-b57f31cfe479 could not be found. Jul 01 04:15:23.193885 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi Jul 01 04:15:23.193885 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 04:15:23.193885 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi Jul 01 04:15:23.193885 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 04:15:23.193885 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 04:15:23.193885 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 04:15:23.193885 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 04:15:23.193885 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 04:15:23.193885 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 04:15:23.195354 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 04:15:23.195354 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 01 04:15:23.195354 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 01 04:15:23.195354 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 01 04:15:23.195354 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 01 04:15:23.195354 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 04:15:23.195354 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 04:15:23.195354 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 04:15:23.195354 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 04:15:23.195354 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0c303914-e7aa-4775-a6ae-b57f31cfe479 could not be found. Jul 01 04:15:23.195354 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi Jul 01 04:15:23.195354 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 04:15:23.195354 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi Jul 01 04:15:23.195354 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 04:15:23.195354 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 04:15:23.195354 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 04:15:23.195354 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 04:15:23.195354 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 04:15:23.195354 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0c303914-e7aa-4775-a6ae-b57f31cfe479 could not be found. Jul 01 04:15:23.195354 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi Jul 01 04:15:23.196884 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-e3cff15b-bce8-4117-a043-7a3258bf121c tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Returning 404 to user: Instance 0c303914-e7aa-4775-a6ae-b57f31cfe479 could not be found. {{(pid=118712) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 04:15:23.196884 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-e3cff15b-bce8-4117-a043-7a3258bf121c tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] 10.222.0.20 "DELETE /compute/v2.1/servers/0c303914-e7aa-4775-a6ae-b57f31cfe479" status: 404 len: 111 microversion: 2.1 time: 0.034197 Jul 01 04:15:23.196884 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 468/929] 10.222.0.20 () {58 vars in 1238 bytes} [Fri Jul 1 04:15:23 2022] DELETE /compute/v2.1/servers/0c303914-e7aa-4775-a6ae-b57f31cfe479 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 04:15:23.206238 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-fe1f9356-200c-4ee9-9620-5910cd0cbd1c tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:15:23.206862 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-fe1f9356-200c-4ee9-9620-5910cd0cbd1c tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] [instance: 0c303914-e7aa-4775-a6ae-b57f31cfe479] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:15:23.213431 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-fe1f9356-200c-4ee9-9620-5910cd0cbd1c tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:15:23.213893 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-fe1f9356-200c-4ee9-9620-5910cd0cbd1c tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:15:23.214701 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-fe1f9356-200c-4ee9-9620-5910cd0cbd1c tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:15:23.215117 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-fe1f9356-200c-4ee9-9620-5910cd0cbd1c tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:15:23.230010 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.wsgi [None req-fe1f9356-200c-4ee9-9620-5910cd0cbd1c tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] HTTP exception thrown: Instance 0c303914-e7aa-4775-a6ae-b57f31cfe479 could not be found. Jul 01 04:15:23.231819 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-fe1f9356-200c-4ee9-9620-5910cd0cbd1c tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Request method failure captured: Jul 01 04:15:23.231819 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: request: GET /compute/v2.1/servers/0c303914-e7aa-4775-a6ae-b57f31cfe479 HTTP/1.1 Jul 01 04:15:23.231819 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: Accept: application/json Jul 01 04:15:23.231819 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: Accept-Encoding: identity Jul 01 04:15:23.231819 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: Connection: close Jul 01 04:15:23.231819 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: Content-Length: 0 Jul 01 04:15:23.231819 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: Content-Type: application/json Jul 01 04:15:23.231819 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: Host: 10.222.0.20 Jul 01 04:15:23.231819 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: Openstack-System-Scope: None Jul 01 04:15:23.231819 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: User-Agent: python-urllib3/1.26.9 Jul 01 04:15:23.231819 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Auth-Token: gAAAAABivnO_2SHspn5040vH8P4vp6P_nHqsfbY2b8BaTxMU37E-Nm1nW3UiPrXBDY7TPTOcTyJxuvdXyhrWNFcAJgF991L1LL3g9HBHqdiHQSEKxKFPESilMhAE3M7664WhTBceQb5njdTfXXYCgJ_rjpGbTLpsJzn6ZaZQDIGWFCb9NOvUG5w Jul 01 04:15:23.231819 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Domain-Id: None Jul 01 04:15:23.231819 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Domain-Name: None Jul 01 04:15:23.231819 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Identity-Status: Confirmed Jul 01 04:15:23.231819 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Is-Admin-Project: True Jul 01 04:15:23.231819 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Project-Domain-Id: default Jul 01 04:15:23.231819 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Project-Domain-Name: Default Jul 01 04:15:23.231819 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Project-Id: f76a684261dd49f68a42a4e157355f37 Jul 01 04:15:23.231819 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Project-Name: tempest-AttachVolumeNegativeTest-1321993683 Jul 01 04:15:23.231819 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Role: reader,member Jul 01 04:15:23.231819 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Roles: reader,member Jul 01 04:15:23.233453 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/f76a684261dd49f68a42a4e157355f37"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_f76a684261dd49f68a42a4e157355f37", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f76a684261dd49f68a42a4e157355f37"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f76a684261dd49f68a42a4e157355f37"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}] Jul 01 04:15:23.233453 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Tenant: tempest-AttachVolumeNegativeTest-1321993683 Jul 01 04:15:23.233453 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Tenant-Id: f76a684261dd49f68a42a4e157355f37 Jul 01 04:15:23.233453 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1321993683 Jul 01 04:15:23.233453 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-User: tempest-AttachVolumeNegativeTest-1321993683-project Jul 01 04:15:23.233453 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-User-Domain-Id: default Jul 01 04:15:23.233453 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-User-Domain-Name: Default Jul 01 04:15:23.233453 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-User-Id: 4ac71714265342098d2487a701a6c364 Jul 01 04:15:23.233453 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-User-Name: tempest-AttachVolumeNegativeTest-1321993683-project Jul 01 04:15:23.233453 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: method: > Jul 01 04:15:23.233453 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: exception: Instance 0c303914-e7aa-4775-a6ae-b57f31cfe479 could not be found. Jul 01 04:15:23.233453 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: action_args: {'id': '0c303914-e7aa-4775-a6ae-b57f31cfe479'} Jul 01 04:15:23.234303 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 04:15:23.234303 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 04:15:23.234303 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 04:15:23.234303 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 04:15:23.234303 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 04:15:23.234303 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 04:15:23.234303 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 04:15:23.234303 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 04:15:23.234303 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 04:15:23.234303 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 04:15:23.234303 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0c303914-e7aa-4775-a6ae-b57f31cfe479 could not be found. Jul 01 04:15:23.234303 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi Jul 01 04:15:23.234303 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 04:15:23.234303 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi Jul 01 04:15:23.234303 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 04:15:23.234303 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 04:15:23.234303 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 04:15:23.234303 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 04:15:23.234303 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 04:15:23.234303 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 04:15:23.235655 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 04:15:23.235655 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 04:15:23.235655 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 04:15:23.235655 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 04:15:23.235655 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 04:15:23.235655 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 04:15:23.235655 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 04:15:23.235655 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0c303914-e7aa-4775-a6ae-b57f31cfe479 could not be found. Jul 01 04:15:23.235655 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi Jul 01 04:15:23.235655 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 04:15:23.235655 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi Jul 01 04:15:23.235655 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 04:15:23.235655 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 04:15:23.235655 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 04:15:23.235655 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 04:15:23.235655 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 04:15:23.235655 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0c303914-e7aa-4775-a6ae-b57f31cfe479 could not be found. Jul 01 04:15:23.235655 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi Jul 01 04:15:23.237218 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-fe1f9356-200c-4ee9-9620-5910cd0cbd1c tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Returning 404 to user: Instance 0c303914-e7aa-4775-a6ae-b57f31cfe479 could not be found. {{(pid=118712) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 04:15:23.237218 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-fe1f9356-200c-4ee9-9620-5910cd0cbd1c tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] 10.222.0.20 "GET /compute/v2.1/servers/0c303914-e7aa-4775-a6ae-b57f31cfe479" status: 404 len: 111 microversion: 2.1 time: 0.031909 Jul 01 04:15:23.237218 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 469/930] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:15:23 2022] GET /compute/v2.1/servers/0c303914-e7aa-4775-a6ae-b57f31cfe479 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 01 04:15:23.243826 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-032b3802-4fa1-4946-9562-5c704a9f3a82 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:15:23.244363 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-032b3802-4fa1-4946-9562-5c704a9f3a82 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] [instance: 81741be3-0961-4d2f-b011-815232b30145] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:15:23.250394 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-032b3802-4fa1-4946-9562-5c704a9f3a82 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:15:23.250856 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-032b3802-4fa1-4946-9562-5c704a9f3a82 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:15:23.251657 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-032b3802-4fa1-4946-9562-5c704a9f3a82 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:15:23.252104 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-032b3802-4fa1-4946-9562-5c704a9f3a82 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:15:23.266363 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.wsgi [None req-032b3802-4fa1-4946-9562-5c704a9f3a82 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] HTTP exception thrown: Instance 81741be3-0961-4d2f-b011-815232b30145 could not be found. Jul 01 04:15:23.267961 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-032b3802-4fa1-4946-9562-5c704a9f3a82 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Request method failure captured: Jul 01 04:15:23.267961 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: request: DELETE /compute/v2.1/servers/81741be3-0961-4d2f-b011-815232b30145 HTTP/1.1 Jul 01 04:15:23.267961 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: Accept: application/json Jul 01 04:15:23.267961 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: Accept-Encoding: identity Jul 01 04:15:23.267961 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: Connection: close Jul 01 04:15:23.267961 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: Content-Length: 0 Jul 01 04:15:23.267961 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: Content-Type: application/json Jul 01 04:15:23.267961 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: Host: 10.222.0.20 Jul 01 04:15:23.267961 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: Openstack-System-Scope: None Jul 01 04:15:23.267961 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: User-Agent: python-urllib3/1.26.9 Jul 01 04:15:23.267961 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Auth-Token: gAAAAABivnO_2SHspn5040vH8P4vp6P_nHqsfbY2b8BaTxMU37E-Nm1nW3UiPrXBDY7TPTOcTyJxuvdXyhrWNFcAJgF991L1LL3g9HBHqdiHQSEKxKFPESilMhAE3M7664WhTBceQb5njdTfXXYCgJ_rjpGbTLpsJzn6ZaZQDIGWFCb9NOvUG5w Jul 01 04:15:23.267961 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Domain-Id: None Jul 01 04:15:23.267961 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Domain-Name: None Jul 01 04:15:23.267961 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Identity-Status: Confirmed Jul 01 04:15:23.267961 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Is-Admin-Project: True Jul 01 04:15:23.267961 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Project-Domain-Id: default Jul 01 04:15:23.267961 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Project-Domain-Name: Default Jul 01 04:15:23.267961 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Project-Id: f76a684261dd49f68a42a4e157355f37 Jul 01 04:15:23.267961 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Project-Name: tempest-AttachVolumeNegativeTest-1321993683 Jul 01 04:15:23.267961 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Role: reader,member Jul 01 04:15:23.267961 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Roles: reader,member Jul 01 04:15:23.269658 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/f76a684261dd49f68a42a4e157355f37"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_f76a684261dd49f68a42a4e157355f37", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f76a684261dd49f68a42a4e157355f37"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f76a684261dd49f68a42a4e157355f37"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}] Jul 01 04:15:23.269658 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Tenant: tempest-AttachVolumeNegativeTest-1321993683 Jul 01 04:15:23.269658 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Tenant-Id: f76a684261dd49f68a42a4e157355f37 Jul 01 04:15:23.269658 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1321993683 Jul 01 04:15:23.269658 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-User: tempest-AttachVolumeNegativeTest-1321993683-project Jul 01 04:15:23.269658 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-User-Domain-Id: default Jul 01 04:15:23.269658 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-User-Domain-Name: Default Jul 01 04:15:23.269658 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-User-Id: 4ac71714265342098d2487a701a6c364 Jul 01 04:15:23.269658 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-User-Name: tempest-AttachVolumeNegativeTest-1321993683-project Jul 01 04:15:23.269658 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: method: > Jul 01 04:15:23.269658 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: exception: Instance 81741be3-0961-4d2f-b011-815232b30145 could not be found. Jul 01 04:15:23.269658 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: action_args: {'id': '81741be3-0961-4d2f-b011-815232b30145'} Jul 01 04:15:23.270470 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 04:15:23.270470 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 04:15:23.270470 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 04:15:23.270470 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 04:15:23.270470 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 04:15:23.270470 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 04:15:23.270470 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 04:15:23.270470 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 04:15:23.270470 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 04:15:23.270470 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 04:15:23.270470 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 81741be3-0961-4d2f-b011-815232b30145 could not be found. Jul 01 04:15:23.270470 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi Jul 01 04:15:23.270470 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 04:15:23.270470 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi Jul 01 04:15:23.270470 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 04:15:23.270470 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 04:15:23.270470 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 04:15:23.270470 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 04:15:23.270470 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 04:15:23.270470 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 04:15:23.271714 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 04:15:23.271714 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 01 04:15:23.271714 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 01 04:15:23.271714 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 01 04:15:23.271714 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 01 04:15:23.271714 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 04:15:23.271714 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 04:15:23.271714 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 04:15:23.271714 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 04:15:23.271714 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 81741be3-0961-4d2f-b011-815232b30145 could not be found. Jul 01 04:15:23.271714 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi Jul 01 04:15:23.271714 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 04:15:23.271714 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi Jul 01 04:15:23.271714 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 04:15:23.271714 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 04:15:23.271714 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 04:15:23.271714 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 04:15:23.271714 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 04:15:23.271714 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 81741be3-0961-4d2f-b011-815232b30145 could not be found. Jul 01 04:15:23.271714 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi Jul 01 04:15:23.272960 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-032b3802-4fa1-4946-9562-5c704a9f3a82 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Returning 404 to user: Instance 81741be3-0961-4d2f-b011-815232b30145 could not be found. {{(pid=118712) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 04:15:23.272960 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-032b3802-4fa1-4946-9562-5c704a9f3a82 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] 10.222.0.20 "DELETE /compute/v2.1/servers/81741be3-0961-4d2f-b011-815232b30145" status: 404 len: 111 microversion: 2.1 time: 0.029500 Jul 01 04:15:23.272960 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 470/931] 10.222.0.20 () {58 vars in 1238 bytes} [Fri Jul 1 04:15:23 2022] DELETE /compute/v2.1/servers/81741be3-0961-4d2f-b011-815232b30145 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 04:15:23.277917 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-3740fb00-92dd-48e6-82f2-48536ef49f20 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:15:23.278524 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-3740fb00-92dd-48e6-82f2-48536ef49f20 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] [instance: 81741be3-0961-4d2f-b011-815232b30145] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:15:23.285234 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-3740fb00-92dd-48e6-82f2-48536ef49f20 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:15:23.285687 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-3740fb00-92dd-48e6-82f2-48536ef49f20 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:15:23.286463 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-3740fb00-92dd-48e6-82f2-48536ef49f20 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:15:23.286907 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-3740fb00-92dd-48e6-82f2-48536ef49f20 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:15:23.300501 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.wsgi [None req-3740fb00-92dd-48e6-82f2-48536ef49f20 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] HTTP exception thrown: Instance 81741be3-0961-4d2f-b011-815232b30145 could not be found. Jul 01 04:15:23.302041 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-3740fb00-92dd-48e6-82f2-48536ef49f20 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Request method failure captured: Jul 01 04:15:23.302041 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: request: GET /compute/v2.1/servers/81741be3-0961-4d2f-b011-815232b30145 HTTP/1.1 Jul 01 04:15:23.302041 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: Accept: application/json Jul 01 04:15:23.302041 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: Accept-Encoding: identity Jul 01 04:15:23.302041 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: Connection: close Jul 01 04:15:23.302041 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: Content-Length: 0 Jul 01 04:15:23.302041 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: Content-Type: application/json Jul 01 04:15:23.302041 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: Host: 10.222.0.20 Jul 01 04:15:23.302041 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: Openstack-System-Scope: None Jul 01 04:15:23.302041 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: User-Agent: python-urllib3/1.26.9 Jul 01 04:15:23.302041 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Auth-Token: gAAAAABivnO_2SHspn5040vH8P4vp6P_nHqsfbY2b8BaTxMU37E-Nm1nW3UiPrXBDY7TPTOcTyJxuvdXyhrWNFcAJgF991L1LL3g9HBHqdiHQSEKxKFPESilMhAE3M7664WhTBceQb5njdTfXXYCgJ_rjpGbTLpsJzn6ZaZQDIGWFCb9NOvUG5w Jul 01 04:15:23.302041 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Domain-Id: None Jul 01 04:15:23.302041 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Domain-Name: None Jul 01 04:15:23.302041 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Identity-Status: Confirmed Jul 01 04:15:23.302041 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Is-Admin-Project: True Jul 01 04:15:23.302041 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Project-Domain-Id: default Jul 01 04:15:23.302041 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Project-Domain-Name: Default Jul 01 04:15:23.302041 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Project-Id: f76a684261dd49f68a42a4e157355f37 Jul 01 04:15:23.302041 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Project-Name: tempest-AttachVolumeNegativeTest-1321993683 Jul 01 04:15:23.302041 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Role: reader,member Jul 01 04:15:23.302041 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Roles: reader,member Jul 01 04:15:23.303700 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/f76a684261dd49f68a42a4e157355f37"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_f76a684261dd49f68a42a4e157355f37", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f76a684261dd49f68a42a4e157355f37"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f76a684261dd49f68a42a4e157355f37"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}] Jul 01 04:15:23.303700 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Tenant: tempest-AttachVolumeNegativeTest-1321993683 Jul 01 04:15:23.303700 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Tenant-Id: f76a684261dd49f68a42a4e157355f37 Jul 01 04:15:23.303700 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1321993683 Jul 01 04:15:23.303700 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-User: tempest-AttachVolumeNegativeTest-1321993683-project Jul 01 04:15:23.303700 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-User-Domain-Id: default Jul 01 04:15:23.303700 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-User-Domain-Name: Default Jul 01 04:15:23.303700 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-User-Id: 4ac71714265342098d2487a701a6c364 Jul 01 04:15:23.303700 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-User-Name: tempest-AttachVolumeNegativeTest-1321993683-project Jul 01 04:15:23.303700 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: method: > Jul 01 04:15:23.303700 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: exception: Instance 81741be3-0961-4d2f-b011-815232b30145 could not be found. Jul 01 04:15:23.303700 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: action_args: {'id': '81741be3-0961-4d2f-b011-815232b30145'} Jul 01 04:15:23.304599 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 04:15:23.304599 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 04:15:23.304599 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 04:15:23.304599 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 04:15:23.304599 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 04:15:23.304599 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 04:15:23.304599 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 04:15:23.304599 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 04:15:23.304599 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 04:15:23.304599 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 04:15:23.304599 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 81741be3-0961-4d2f-b011-815232b30145 could not be found. Jul 01 04:15:23.304599 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi Jul 01 04:15:23.304599 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 04:15:23.304599 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi Jul 01 04:15:23.304599 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 04:15:23.304599 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 04:15:23.304599 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 04:15:23.304599 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 04:15:23.304599 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 04:15:23.304599 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 04:15:23.305897 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 04:15:23.305897 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 04:15:23.305897 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 04:15:23.305897 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 04:15:23.305897 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 04:15:23.305897 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 04:15:23.305897 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 04:15:23.305897 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 81741be3-0961-4d2f-b011-815232b30145 could not be found. Jul 01 04:15:23.305897 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi Jul 01 04:15:23.305897 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 04:15:23.305897 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi Jul 01 04:15:23.305897 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 04:15:23.305897 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 04:15:23.305897 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 04:15:23.305897 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 04:15:23.305897 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 04:15:23.305897 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 81741be3-0961-4d2f-b011-815232b30145 could not be found. Jul 01 04:15:23.305897 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi Jul 01 04:15:23.307141 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-3740fb00-92dd-48e6-82f2-48536ef49f20 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Returning 404 to user: Instance 81741be3-0961-4d2f-b011-815232b30145 could not be found. {{(pid=118712) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 04:15:23.307141 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-3740fb00-92dd-48e6-82f2-48536ef49f20 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] 10.222.0.20 "GET /compute/v2.1/servers/81741be3-0961-4d2f-b011-815232b30145" status: 404 len: 111 microversion: 2.1 time: 0.029234 Jul 01 04:15:23.307141 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 471/932] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:15:23 2022] GET /compute/v2.1/servers/81741be3-0961-4d2f-b011-815232b30145 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 04:15:23.370125 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-1ff5e5f2-f1b8-47da-80dd-4d81f759c2c1 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73d76a988462431fa6bb03dca64463a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9614129d1e864c3ea288aaac8387c5d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:15:23.377631 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-1ff5e5f2-f1b8-47da-80dd-4d81f759c2c1 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] 10.222.0.20 "GET /compute/v2.1/servers/20264c61-166b-4dce-9121-d530cedf677f" status: 200 len: 1362 microversion: 2.1 time: 0.210528 Jul 01 04:15:23.378189 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 462/933] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:15:23 2022] GET /compute/v2.1/servers/20264c61-166b-4dce-9121-d530cedf677f => generated 1362 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 04:15:24.399643 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-2d8f420a-da05-4859-a281-585a1f5ca6e7 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:15:24.400181 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-2d8f420a-da05-4859-a281-585a1f5ca6e7 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] [instance: 20264c61-166b-4dce-9121-d530cedf677f] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:15:24.406609 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-2d8f420a-da05-4859-a281-585a1f5ca6e7 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:15:24.407054 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-2d8f420a-da05-4859-a281-585a1f5ca6e7 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:15:24.407853 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-2d8f420a-da05-4859-a281-585a1f5ca6e7 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:15:24.408285 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-2d8f420a-da05-4859-a281-585a1f5ca6e7 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:15:24.542233 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-2d8f420a-da05-4859-a281-585a1f5ca6e7 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73d76a988462431fa6bb03dca64463a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9614129d1e864c3ea288aaac8387c5d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:15:24.549868 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-2d8f420a-da05-4859-a281-585a1f5ca6e7 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] 10.222.0.20 "GET /compute/v2.1/servers/20264c61-166b-4dce-9121-d530cedf677f" status: 200 len: 1362 microversion: 2.1 time: 0.154199 Jul 01 04:15:24.550650 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 472/934] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:15:24 2022] GET /compute/v2.1/servers/20264c61-166b-4dce-9121-d530cedf677f => generated 1362 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:15:24.637990 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-f6d36ec1-9177-45f3-aedc-ee55c64d793a tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:15:24.638492 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-f6d36ec1-9177-45f3-aedc-ee55c64d793a tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] [instance: 8e620fdf-cea4-431c-abd4-006a5dd37f88] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:15:24.645111 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-f6d36ec1-9177-45f3-aedc-ee55c64d793a tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:15:24.645563 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-f6d36ec1-9177-45f3-aedc-ee55c64d793a tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:15:24.646327 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-f6d36ec1-9177-45f3-aedc-ee55c64d793a tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:15:24.646761 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-f6d36ec1-9177-45f3-aedc-ee55c64d793a tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:15:24.659794 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.wsgi [None req-f6d36ec1-9177-45f3-aedc-ee55c64d793a tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] HTTP exception thrown: Instance 8e620fdf-cea4-431c-abd4-006a5dd37f88 could not be found. Jul 01 04:15:24.661375 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-f6d36ec1-9177-45f3-aedc-ee55c64d793a tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Request method failure captured: Jul 01 04:15:24.661375 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: request: DELETE /compute/v2.1/servers/8e620fdf-cea4-431c-abd4-006a5dd37f88 HTTP/1.1 Jul 01 04:15:24.661375 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: Accept: application/json Jul 01 04:15:24.661375 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: Accept-Encoding: identity Jul 01 04:15:24.661375 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: Connection: close Jul 01 04:15:24.661375 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: Content-Length: 0 Jul 01 04:15:24.661375 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: Content-Type: application/json Jul 01 04:15:24.661375 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: Host: 10.222.0.20 Jul 01 04:15:24.661375 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: Openstack-System-Scope: None Jul 01 04:15:24.661375 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: User-Agent: python-urllib3/1.26.9 Jul 01 04:15:24.661375 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-Auth-Token: gAAAAABivnO_2SHspn5040vH8P4vp6P_nHqsfbY2b8BaTxMU37E-Nm1nW3UiPrXBDY7TPTOcTyJxuvdXyhrWNFcAJgF991L1LL3g9HBHqdiHQSEKxKFPESilMhAE3M7664WhTBceQb5njdTfXXYCgJ_rjpGbTLpsJzn6ZaZQDIGWFCb9NOvUG5w Jul 01 04:15:24.661375 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-Domain-Id: None Jul 01 04:15:24.661375 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-Domain-Name: None Jul 01 04:15:24.661375 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-Identity-Status: Confirmed Jul 01 04:15:24.661375 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-Is-Admin-Project: True Jul 01 04:15:24.661375 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-Project-Domain-Id: default Jul 01 04:15:24.661375 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-Project-Domain-Name: Default Jul 01 04:15:24.661375 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-Project-Id: f76a684261dd49f68a42a4e157355f37 Jul 01 04:15:24.661375 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-Project-Name: tempest-AttachVolumeNegativeTest-1321993683 Jul 01 04:15:24.661375 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-Role: reader,member Jul 01 04:15:24.661375 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-Roles: reader,member Jul 01 04:15:24.662976 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/f76a684261dd49f68a42a4e157355f37"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_f76a684261dd49f68a42a4e157355f37", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f76a684261dd49f68a42a4e157355f37"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f76a684261dd49f68a42a4e157355f37"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}] Jul 01 04:15:24.662976 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-Tenant: tempest-AttachVolumeNegativeTest-1321993683 Jul 01 04:15:24.662976 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-Tenant-Id: f76a684261dd49f68a42a4e157355f37 Jul 01 04:15:24.662976 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1321993683 Jul 01 04:15:24.662976 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-User: tempest-AttachVolumeNegativeTest-1321993683-project Jul 01 04:15:24.662976 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-User-Domain-Id: default Jul 01 04:15:24.662976 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-User-Domain-Name: Default Jul 01 04:15:24.662976 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-User-Id: 4ac71714265342098d2487a701a6c364 Jul 01 04:15:24.662976 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-User-Name: tempest-AttachVolumeNegativeTest-1321993683-project Jul 01 04:15:24.662976 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: method: > Jul 01 04:15:24.662976 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: exception: Instance 8e620fdf-cea4-431c-abd4-006a5dd37f88 could not be found. Jul 01 04:15:24.662976 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: action_args: {'id': '8e620fdf-cea4-431c-abd4-006a5dd37f88'} Jul 01 04:15:24.663909 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 04:15:24.663909 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 04:15:24.663909 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 04:15:24.663909 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 04:15:24.663909 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 04:15:24.663909 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 04:15:24.663909 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 04:15:24.663909 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 04:15:24.663909 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 04:15:24.663909 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 04:15:24.663909 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8e620fdf-cea4-431c-abd4-006a5dd37f88 could not be found. Jul 01 04:15:24.663909 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi Jul 01 04:15:24.663909 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 04:15:24.663909 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi Jul 01 04:15:24.663909 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 04:15:24.663909 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 04:15:24.663909 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 04:15:24.663909 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 04:15:24.663909 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 04:15:24.663909 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 04:15:24.665427 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 04:15:24.665427 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 01 04:15:24.665427 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 01 04:15:24.665427 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 01 04:15:24.665427 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 01 04:15:24.665427 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 04:15:24.665427 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 04:15:24.665427 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 04:15:24.665427 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 04:15:24.665427 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8e620fdf-cea4-431c-abd4-006a5dd37f88 could not be found. Jul 01 04:15:24.665427 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi Jul 01 04:15:24.665427 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 04:15:24.665427 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi Jul 01 04:15:24.665427 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 04:15:24.665427 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 04:15:24.665427 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 04:15:24.665427 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 04:15:24.665427 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 04:15:24.665427 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8e620fdf-cea4-431c-abd4-006a5dd37f88 could not be found. Jul 01 04:15:24.665427 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi Jul 01 04:15:24.666874 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-f6d36ec1-9177-45f3-aedc-ee55c64d793a tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Returning 404 to user: Instance 8e620fdf-cea4-431c-abd4-006a5dd37f88 could not be found. {{(pid=118711) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 04:15:24.666874 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-f6d36ec1-9177-45f3-aedc-ee55c64d793a tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] 10.222.0.20 "DELETE /compute/v2.1/servers/8e620fdf-cea4-431c-abd4-006a5dd37f88" status: 404 len: 111 microversion: 2.1 time: 0.028608 Jul 01 04:15:24.666874 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 463/935] 10.222.0.20 () {58 vars in 1238 bytes} [Fri Jul 1 04:15:24 2022] DELETE /compute/v2.1/servers/8e620fdf-cea4-431c-abd4-006a5dd37f88 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 04:15:24.671203 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-2346940f-8369-4e9d-8b8d-0365a13adf19 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:15:24.672410 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-2346940f-8369-4e9d-8b8d-0365a13adf19 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] [instance: 8e620fdf-cea4-431c-abd4-006a5dd37f88] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:15:24.678321 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-2346940f-8369-4e9d-8b8d-0365a13adf19 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:15:24.678768 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-2346940f-8369-4e9d-8b8d-0365a13adf19 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:15:24.679559 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-2346940f-8369-4e9d-8b8d-0365a13adf19 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:15:24.680003 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-2346940f-8369-4e9d-8b8d-0365a13adf19 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:15:24.693965 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.wsgi [None req-2346940f-8369-4e9d-8b8d-0365a13adf19 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] HTTP exception thrown: Instance 8e620fdf-cea4-431c-abd4-006a5dd37f88 could not be found. Jul 01 04:15:24.695513 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-2346940f-8369-4e9d-8b8d-0365a13adf19 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Request method failure captured: Jul 01 04:15:24.695513 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: request: GET /compute/v2.1/servers/8e620fdf-cea4-431c-abd4-006a5dd37f88 HTTP/1.1 Jul 01 04:15:24.695513 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: Accept: application/json Jul 01 04:15:24.695513 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: Accept-Encoding: identity Jul 01 04:15:24.695513 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: Connection: close Jul 01 04:15:24.695513 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: Content-Length: 0 Jul 01 04:15:24.695513 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: Content-Type: application/json Jul 01 04:15:24.695513 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: Host: 10.222.0.20 Jul 01 04:15:24.695513 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: Openstack-System-Scope: None Jul 01 04:15:24.695513 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: User-Agent: python-urllib3/1.26.9 Jul 01 04:15:24.695513 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Auth-Token: gAAAAABivnO_2SHspn5040vH8P4vp6P_nHqsfbY2b8BaTxMU37E-Nm1nW3UiPrXBDY7TPTOcTyJxuvdXyhrWNFcAJgF991L1LL3g9HBHqdiHQSEKxKFPESilMhAE3M7664WhTBceQb5njdTfXXYCgJ_rjpGbTLpsJzn6ZaZQDIGWFCb9NOvUG5w Jul 01 04:15:24.695513 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Domain-Id: None Jul 01 04:15:24.695513 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Domain-Name: None Jul 01 04:15:24.695513 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Identity-Status: Confirmed Jul 01 04:15:24.695513 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Is-Admin-Project: True Jul 01 04:15:24.695513 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Project-Domain-Id: default Jul 01 04:15:24.695513 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Project-Domain-Name: Default Jul 01 04:15:24.695513 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Project-Id: f76a684261dd49f68a42a4e157355f37 Jul 01 04:15:24.695513 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Project-Name: tempest-AttachVolumeNegativeTest-1321993683 Jul 01 04:15:24.695513 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Role: reader,member Jul 01 04:15:24.695513 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Roles: reader,member Jul 01 04:15:24.697117 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/f76a684261dd49f68a42a4e157355f37"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_f76a684261dd49f68a42a4e157355f37", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f76a684261dd49f68a42a4e157355f37"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f76a684261dd49f68a42a4e157355f37"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}] Jul 01 04:15:24.697117 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Tenant: tempest-AttachVolumeNegativeTest-1321993683 Jul 01 04:15:24.697117 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Tenant-Id: f76a684261dd49f68a42a4e157355f37 Jul 01 04:15:24.697117 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1321993683 Jul 01 04:15:24.697117 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-User: tempest-AttachVolumeNegativeTest-1321993683-project Jul 01 04:15:24.697117 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-User-Domain-Id: default Jul 01 04:15:24.697117 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-User-Domain-Name: Default Jul 01 04:15:24.697117 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-User-Id: 4ac71714265342098d2487a701a6c364 Jul 01 04:15:24.697117 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-User-Name: tempest-AttachVolumeNegativeTest-1321993683-project Jul 01 04:15:24.697117 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: method: > Jul 01 04:15:24.697117 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: exception: Instance 8e620fdf-cea4-431c-abd4-006a5dd37f88 could not be found. Jul 01 04:15:24.697117 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: action_args: {'id': '8e620fdf-cea4-431c-abd4-006a5dd37f88'} Jul 01 04:15:24.697976 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 04:15:24.697976 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 04:15:24.697976 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 04:15:24.697976 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 04:15:24.697976 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 04:15:24.697976 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 04:15:24.697976 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 04:15:24.697976 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 04:15:24.697976 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 04:15:24.697976 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 04:15:24.697976 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8e620fdf-cea4-431c-abd4-006a5dd37f88 could not be found. Jul 01 04:15:24.697976 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi Jul 01 04:15:24.697976 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 04:15:24.697976 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi Jul 01 04:15:24.697976 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 04:15:24.697976 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 04:15:24.697976 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 04:15:24.697976 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 04:15:24.697976 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 04:15:24.697976 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 04:15:24.699180 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 04:15:24.699180 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 04:15:24.699180 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 04:15:24.699180 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 04:15:24.699180 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 04:15:24.699180 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 04:15:24.699180 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 04:15:24.699180 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8e620fdf-cea4-431c-abd4-006a5dd37f88 could not be found. Jul 01 04:15:24.699180 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi Jul 01 04:15:24.699180 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 04:15:24.699180 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi Jul 01 04:15:24.699180 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 04:15:24.699180 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 04:15:24.699180 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 04:15:24.699180 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 04:15:24.699180 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 04:15:24.699180 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8e620fdf-cea4-431c-abd4-006a5dd37f88 could not be found. Jul 01 04:15:24.699180 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi Jul 01 04:15:24.700458 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-2346940f-8369-4e9d-8b8d-0365a13adf19 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] Returning 404 to user: Instance 8e620fdf-cea4-431c-abd4-006a5dd37f88 could not be found. {{(pid=118712) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 04:15:24.700458 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-2346940f-8369-4e9d-8b8d-0365a13adf19 tempest-AttachVolumeNegativeTest-1321993683 tempest-AttachVolumeNegativeTest-1321993683-project] 10.222.0.20 "GET /compute/v2.1/servers/8e620fdf-cea4-431c-abd4-006a5dd37f88" status: 404 len: 111 microversion: 2.1 time: 0.029552 Jul 01 04:15:24.700458 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 473/936] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:15:24 2022] GET /compute/v2.1/servers/8e620fdf-cea4-431c-abd4-006a5dd37f88 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 04:15:25.565785 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-aeb4b584-df8c-42b3-8c07-187013ef1933 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:15:25.566386 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-aeb4b584-df8c-42b3-8c07-187013ef1933 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] [instance: 20264c61-166b-4dce-9121-d530cedf677f] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:15:25.573086 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-aeb4b584-df8c-42b3-8c07-187013ef1933 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:15:25.573542 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-aeb4b584-df8c-42b3-8c07-187013ef1933 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:15:25.574295 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-aeb4b584-df8c-42b3-8c07-187013ef1933 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:15:25.574727 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-aeb4b584-df8c-42b3-8c07-187013ef1933 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:15:25.594629 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG dbcounter [-] [118711] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=118711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:15:25.730963 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-aeb4b584-df8c-42b3-8c07-187013ef1933 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73d76a988462431fa6bb03dca64463a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9614129d1e864c3ea288aaac8387c5d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:15:25.740102 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-aeb4b584-df8c-42b3-8c07-187013ef1933 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] 10.222.0.20 "GET /compute/v2.1/servers/20264c61-166b-4dce-9121-d530cedf677f" status: 200 len: 1362 microversion: 2.1 time: 0.177678 Jul 01 04:15:25.740780 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 464/937] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:15:25 2022] GET /compute/v2.1/servers/20264c61-166b-4dce-9121-d530cedf677f => generated 1362 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:15:26.757502 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-4b1de63a-4b1b-4098-a62b-734c14fb317e tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:15:26.758132 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-4b1de63a-4b1b-4098-a62b-734c14fb317e tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] [instance: 20264c61-166b-4dce-9121-d530cedf677f] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:15:26.769120 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-4b1de63a-4b1b-4098-a62b-734c14fb317e tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:15:26.769601 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-4b1de63a-4b1b-4098-a62b-734c14fb317e tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:15:26.770377 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-4b1de63a-4b1b-4098-a62b-734c14fb317e tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:15:26.770829 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-4b1de63a-4b1b-4098-a62b-734c14fb317e tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:15:27.305042 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-4b1de63a-4b1b-4098-a62b-734c14fb317e tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73d76a988462431fa6bb03dca64463a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9614129d1e864c3ea288aaac8387c5d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:15:27.313088 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-4b1de63a-4b1b-4098-a62b-734c14fb317e tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] 10.222.0.20 "GET /compute/v2.1/servers/20264c61-166b-4dce-9121-d530cedf677f" status: 200 len: 1362 microversion: 2.1 time: 0.559016 Jul 01 04:15:27.325215 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 474/938] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:15:26 2022] GET /compute/v2.1/servers/20264c61-166b-4dce-9121-d530cedf677f => generated 1362 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 04:15:28.331098 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-a31d23f3-e03b-445e-9f82-570c996ad552 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:15:28.331754 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-a31d23f3-e03b-445e-9f82-570c996ad552 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] [instance: 20264c61-166b-4dce-9121-d530cedf677f] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:15:28.338573 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-a31d23f3-e03b-445e-9f82-570c996ad552 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:15:28.339091 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-a31d23f3-e03b-445e-9f82-570c996ad552 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:15:28.339921 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-a31d23f3-e03b-445e-9f82-570c996ad552 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:15:28.340433 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-a31d23f3-e03b-445e-9f82-570c996ad552 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:15:28.505026 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-a31d23f3-e03b-445e-9f82-570c996ad552 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73d76a988462431fa6bb03dca64463a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9614129d1e864c3ea288aaac8387c5d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:15:28.514898 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-a31d23f3-e03b-445e-9f82-570c996ad552 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] 10.222.0.20 "GET /compute/v2.1/servers/20264c61-166b-4dce-9121-d530cedf677f" status: 200 len: 1362 microversion: 2.1 time: 0.188553 Jul 01 04:15:28.517718 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 465/939] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:15:28 2022] GET /compute/v2.1/servers/20264c61-166b-4dce-9121-d530cedf677f => generated 1362 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:15:28.774773 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [req-97433160-09e5-4c1d-b018-8a6806acc572 req-a08a5b91-a92b-4614-957b-25e63f1e6214 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20264c61-166b-4dce-9121-d530cedf677f", "name": "network-vif-plugged", "status": "completed", "tag": "43920b00-11fc-46a2-8809-9dc05269c7c4"}]} {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 04:15:28.781326 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG dbcounter [-] [118712] Writing DB stats nova_cell0:SELECT=2 {{(pid=118712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:15:28.782338 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG dbcounter [-] [118712] Writing DB stats nova_cell0:SELECT=10 {{(pid=118712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:15:28.787010 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [req-97433160-09e5-4c1d-b018-8a6806acc572 req-a08a5b91-a92b-4614-957b-25e63f1e6214 service nova] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:15:28.794920 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [req-97433160-09e5-4c1d-b018-8a6806acc572 req-a08a5b91-a92b-4614-957b-25e63f1e6214 service nova] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:15:28.794920 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG dbcounter [-] [118712] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:15:28.798822 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.compute.server_external_events [req-97433160-09e5-4c1d-b018-8a6806acc572 req-a08a5b91-a92b-4614-957b-25e63f1e6214 service nova] Creating event network-vif-plugged:43920b00-11fc-46a2-8809-9dc05269c7c4 for instance 20264c61-166b-4dce-9121-d530cedf677f on hv-cinder-84684 Jul 01 04:15:28.803892 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [req-97433160-09e5-4c1d-b018-8a6806acc572 req-a08a5b91-a92b-4614-957b-25e63f1e6214 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033250 Jul 01 04:15:28.804510 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 475/940] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Jul 1 04:15:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 04:15:29.532465 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-388e105d-70f5-476e-84f3-efc0ea66bcd3 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:15:29.533249 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-388e105d-70f5-476e-84f3-efc0ea66bcd3 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] [instance: 20264c61-166b-4dce-9121-d530cedf677f] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:15:29.535084 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG dbcounter [-] [118711] Writing DB stats nova_cell0:SELECT=2 {{(pid=118711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:15:29.540354 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-388e105d-70f5-476e-84f3-efc0ea66bcd3 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:15:29.540865 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-388e105d-70f5-476e-84f3-efc0ea66bcd3 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:15:29.541655 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-388e105d-70f5-476e-84f3-efc0ea66bcd3 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:15:29.542103 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-388e105d-70f5-476e-84f3-efc0ea66bcd3 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:15:29.682919 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-388e105d-70f5-476e-84f3-efc0ea66bcd3 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73d76a988462431fa6bb03dca64463a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9614129d1e864c3ea288aaac8387c5d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:15:29.691058 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-388e105d-70f5-476e-84f3-efc0ea66bcd3 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] 10.222.0.20 "GET /compute/v2.1/servers/20264c61-166b-4dce-9121-d530cedf677f" status: 200 len: 1362 microversion: 2.1 time: 0.162847 Jul 01 04:15:29.700617 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 466/941] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:15:29 2022] GET /compute/v2.1/servers/20264c61-166b-4dce-9121-d530cedf677f => generated 1362 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:15:30.711261 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-535a36dc-a372-4ee7-bcf3-354f396e7c63 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:15:30.711693 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-535a36dc-a372-4ee7-bcf3-354f396e7c63 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] [instance: 20264c61-166b-4dce-9121-d530cedf677f] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:15:30.719204 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-535a36dc-a372-4ee7-bcf3-354f396e7c63 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:15:30.728860 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-535a36dc-a372-4ee7-bcf3-354f396e7c63 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:15:30.728860 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-535a36dc-a372-4ee7-bcf3-354f396e7c63 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:15:30.728860 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-535a36dc-a372-4ee7-bcf3-354f396e7c63 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:15:30.858331 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-535a36dc-a372-4ee7-bcf3-354f396e7c63 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73d76a988462431fa6bb03dca64463a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9614129d1e864c3ea288aaac8387c5d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:15:30.866466 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-535a36dc-a372-4ee7-bcf3-354f396e7c63 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] 10.222.0.20 "GET /compute/v2.1/servers/20264c61-166b-4dce-9121-d530cedf677f" status: 200 len: 1362 microversion: 2.1 time: 0.162042 Jul 01 04:15:30.867042 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 476/942] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:15:30 2022] GET /compute/v2.1/servers/20264c61-166b-4dce-9121-d530cedf677f => generated 1362 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:15:31.883507 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-1fd6c6a9-cf36-47df-8b0c-e6dcce7ee78f tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:15:31.884115 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-1fd6c6a9-cf36-47df-8b0c-e6dcce7ee78f tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] [instance: 20264c61-166b-4dce-9121-d530cedf677f] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:15:31.891813 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-1fd6c6a9-cf36-47df-8b0c-e6dcce7ee78f tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:15:31.892471 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-1fd6c6a9-cf36-47df-8b0c-e6dcce7ee78f tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:15:31.893252 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-1fd6c6a9-cf36-47df-8b0c-e6dcce7ee78f tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:15:31.895151 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-1fd6c6a9-cf36-47df-8b0c-e6dcce7ee78f tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:15:32.125854 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-1fd6c6a9-cf36-47df-8b0c-e6dcce7ee78f tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73d76a988462431fa6bb03dca64463a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9614129d1e864c3ea288aaac8387c5d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:15:32.134023 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-1fd6c6a9-cf36-47df-8b0c-e6dcce7ee78f tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] 10.222.0.20 "GET /compute/v2.1/servers/20264c61-166b-4dce-9121-d530cedf677f" status: 200 len: 1548 microversion: 2.1 time: 0.254592 Jul 01 04:15:32.143597 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 467/943] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:15:31 2022] GET /compute/v2.1/servers/20264c61-166b-4dce-9121-d530cedf677f => generated 1548 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:15:32.153375 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-2de319e4-789f-42d4-bef8-019516d49306 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:15:32.153905 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-2de319e4-789f-42d4-bef8-019516d49306 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] [instance: 20264c61-166b-4dce-9121-d530cedf677f] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:15:32.156868 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG dbcounter [-] [118712] Writing DB stats nova_api:SELECT=79,nova_api:DELETE=1,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=118712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:15:32.162428 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-2de319e4-789f-42d4-bef8-019516d49306 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:15:32.162892 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-2de319e4-789f-42d4-bef8-019516d49306 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:15:32.163733 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-2de319e4-789f-42d4-bef8-019516d49306 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:15:32.166791 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-2de319e4-789f-42d4-bef8-019516d49306 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:15:32.262811 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-2de319e4-789f-42d4-bef8-019516d49306 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] 10.222.0.20 "GET /compute/v2.1/servers/20264c61-166b-4dce-9121-d530cedf677f/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.116018 Jul 01 04:15:32.263442 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 477/944] 10.222.0.20 () {58 vars in 1274 bytes} [Fri Jul 1 04:15:32 2022] GET /compute/v2.1/servers/20264c61-166b-4dce-9121-d530cedf677f/os-interface => generated 285 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 04:15:32.321197 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-5c05cabb-b126-4e4a-9eae-6cff045d25e9 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:15:32.322225 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-5c05cabb-b126-4e4a-9eae-6cff045d25e9 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] [instance: f2e7c278-8bf2-46c0-bc52-bc071ad88b64] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:15:32.332523 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-5c05cabb-b126-4e4a-9eae-6cff045d25e9 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:15:32.336138 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-5c05cabb-b126-4e4a-9eae-6cff045d25e9 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:15:32.336138 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-5c05cabb-b126-4e4a-9eae-6cff045d25e9 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:15:32.336138 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-5c05cabb-b126-4e4a-9eae-6cff045d25e9 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:15:32.338760 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [req-f2597bb1-f999-402d-91be-81ff14a65873 req-b3c38118-6947-48c2-b78c-df5c2f049549 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f2e7c278-8bf2-46c0-bc52-bc071ad88b64", "tag": "57abeebd-e852-43c8-80de-3c0e6f925ab3"}]} {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 04:15:32.356492 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [req-f2597bb1-f999-402d-91be-81ff14a65873 req-b3c38118-6947-48c2-b78c-df5c2f049549 service nova] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:15:32.357220 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [req-f2597bb1-f999-402d-91be-81ff14a65873 req-b3c38118-6947-48c2-b78c-df5c2f049549 service nova] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:15:32.371449 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.compute.server_external_events [req-f2597bb1-f999-402d-91be-81ff14a65873 req-b3c38118-6947-48c2-b78c-df5c2f049549 service nova] Creating event network-changed:57abeebd-e852-43c8-80de-3c0e6f925ab3 for instance f2e7c278-8bf2-46c0-bc52-bc071ad88b64 on hv-cinder-84684 Jul 01 04:15:32.378590 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [req-f2597bb1-f999-402d-91be-81ff14a65873 req-b3c38118-6947-48c2-b78c-df5c2f049549 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049891 Jul 01 04:15:32.379905 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 478/945] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Jul 1 04:15:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 04:15:32.387297 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-5c05cabb-b126-4e4a-9eae-6cff045d25e9 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] [instance: f2e7c278-8bf2-46c0-bc52-bc071ad88b64] Going to try to terminate instance {{(pid=118711) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 01 04:15:32.745870 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-5c05cabb-b126-4e4a-9eae-6cff045d25e9 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] 10.222.0.20 "DELETE /compute/v2.1/servers/f2e7c278-8bf2-46c0-bc52-bc071ad88b64" status: 204 len: 0 microversion: 2.1 time: 0.429897 Jul 01 04:15:32.748061 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 468/946] 10.222.0.20 () {58 vars in 1238 bytes} [Fri Jul 1 04:15:32 2022] DELETE /compute/v2.1/servers/f2e7c278-8bf2-46c0-bc52-bc071ad88b64 => generated 0 bytes in 433 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 01 04:15:32.756711 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-1f381317-1098-4ed6-b8a4-5861bd8e03c9 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:15:32.758016 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-1f381317-1098-4ed6-b8a4-5861bd8e03c9 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] [instance: f2e7c278-8bf2-46c0-bc52-bc071ad88b64] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:15:32.765405 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-1f381317-1098-4ed6-b8a4-5861bd8e03c9 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:15:32.765863 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-1f381317-1098-4ed6-b8a4-5861bd8e03c9 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:15:32.766645 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-1f381317-1098-4ed6-b8a4-5861bd8e03c9 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:15:32.767085 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-1f381317-1098-4ed6-b8a4-5861bd8e03c9 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:15:33.017789 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-1f381317-1098-4ed6-b8a4-5861bd8e03c9 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e9707561b4a4811bd7a7d3fed4fcd6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da99a87350634e9ea8a89f314f5e6118', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:15:33.026393 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-1f381317-1098-4ed6-b8a4-5861bd8e03c9 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] 10.222.0.20 "GET /compute/v2.1/servers/f2e7c278-8bf2-46c0-bc52-bc071ad88b64" status: 200 len: 1578 microversion: 2.1 time: 0.273950 Jul 01 04:15:33.027127 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 479/947] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:15:32 2022] GET /compute/v2.1/servers/f2e7c278-8bf2-46c0-bc52-bc071ad88b64 => generated 1578 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:15:33.713340 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [req-9dd750bc-0936-452b-b8a2-5329551f3670 req-b27db8f3-4016-4562-91db-64df1c384101 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "20264c61-166b-4dce-9121-d530cedf677f", "tag": "43920b00-11fc-46a2-8809-9dc05269c7c4"}]} {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 04:15:33.722157 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG dbcounter [-] [118711] Writing DB stats nova_api:SELECT=62,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=118711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:15:33.741559 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [req-9dd750bc-0936-452b-b8a2-5329551f3670 req-b27db8f3-4016-4562-91db-64df1c384101 service nova] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:15:33.742397 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [req-9dd750bc-0936-452b-b8a2-5329551f3670 req-b27db8f3-4016-4562-91db-64df1c384101 service nova] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:15:33.757175 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.compute.server_external_events [req-9dd750bc-0936-452b-b8a2-5329551f3670 req-b27db8f3-4016-4562-91db-64df1c384101 service nova] Creating event network-changed:43920b00-11fc-46a2-8809-9dc05269c7c4 for instance 20264c61-166b-4dce-9121-d530cedf677f on hv-cinder-84684 Jul 01 04:15:33.762473 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [req-9dd750bc-0936-452b-b8a2-5329551f3670 req-b27db8f3-4016-4562-91db-64df1c384101 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.212373 Jul 01 04:15:33.763393 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 469/948] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Jul 1 04:15:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 04:15:34.048005 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-ccc84235-39b0-4781-b98e-1c8b0aa3a0ba tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:15:34.048779 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-ccc84235-39b0-4781-b98e-1c8b0aa3a0ba tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] [instance: f2e7c278-8bf2-46c0-bc52-bc071ad88b64] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:15:34.055676 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-ccc84235-39b0-4781-b98e-1c8b0aa3a0ba tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:15:34.056270 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-ccc84235-39b0-4781-b98e-1c8b0aa3a0ba tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:15:34.057451 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-ccc84235-39b0-4781-b98e-1c8b0aa3a0ba tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:15:34.058008 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-ccc84235-39b0-4781-b98e-1c8b0aa3a0ba tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:15:34.287207 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-ccc84235-39b0-4781-b98e-1c8b0aa3a0ba tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e9707561b4a4811bd7a7d3fed4fcd6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da99a87350634e9ea8a89f314f5e6118', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:15:34.298612 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-ccc84235-39b0-4781-b98e-1c8b0aa3a0ba tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] 10.222.0.20 "GET /compute/v2.1/servers/f2e7c278-8bf2-46c0-bc52-bc071ad88b64" status: 200 len: 1459 microversion: 2.1 time: 0.257667 Jul 01 04:15:34.300082 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 480/949] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:15:34 2022] GET /compute/v2.1/servers/f2e7c278-8bf2-46c0-bc52-bc071ad88b64 => generated 1459 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:15:34.904600 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [req-02270ba4-503f-46fa-b57e-036daddc3424 req-518d4503-8998-4f42-a22a-8125a3b9e7d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2e7c278-8bf2-46c0-bc52-bc071ad88b64", "name": "network-vif-deleted", "tag": "57abeebd-e852-43c8-80de-3c0e6f925ab3"}]} {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 04:15:34.913486 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [req-02270ba4-503f-46fa-b57e-036daddc3424 req-518d4503-8998-4f42-a22a-8125a3b9e7d2 service nova] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:15:34.914144 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [req-02270ba4-503f-46fa-b57e-036daddc3424 req-518d4503-8998-4f42-a22a-8125a3b9e7d2 service nova] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:15:34.925900 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.compute.server_external_events [req-02270ba4-503f-46fa-b57e-036daddc3424 req-518d4503-8998-4f42-a22a-8125a3b9e7d2 service nova] Creating event network-vif-deleted:57abeebd-e852-43c8-80de-3c0e6f925ab3 for instance f2e7c278-8bf2-46c0-bc52-bc071ad88b64 on hv-cinder-84684 Jul 01 04:15:34.930739 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [req-02270ba4-503f-46fa-b57e-036daddc3424 req-518d4503-8998-4f42-a22a-8125a3b9e7d2 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030714 Jul 01 04:15:34.931370 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 470/950] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Jul 1 04:15:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 04:15:35.325687 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-1f90a57b-c4ed-4a74-bedd-089775bd57cc tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:15:35.330490 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-1f90a57b-c4ed-4a74-bedd-089775bd57cc tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] [instance: f2e7c278-8bf2-46c0-bc52-bc071ad88b64] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:15:35.345721 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-1f90a57b-c4ed-4a74-bedd-089775bd57cc tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:15:35.346296 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-1f90a57b-c4ed-4a74-bedd-089775bd57cc tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:15:35.347384 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-1f90a57b-c4ed-4a74-bedd-089775bd57cc tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:15:35.348887 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-1f90a57b-c4ed-4a74-bedd-089775bd57cc tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:15:35.413422 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-1f90a57b-c4ed-4a74-bedd-089775bd57cc tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e9707561b4a4811bd7a7d3fed4fcd6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da99a87350634e9ea8a89f314f5e6118', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:15:35.422559 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-1f90a57b-c4ed-4a74-bedd-089775bd57cc tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] 10.222.0.20 "GET /compute/v2.1/servers/f2e7c278-8bf2-46c0-bc52-bc071ad88b64" status: 200 len: 1225 microversion: 2.1 time: 0.110185 Jul 01 04:15:35.423787 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 481/951] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:15:35 2022] GET /compute/v2.1/servers/f2e7c278-8bf2-46c0-bc52-bc071ad88b64 => generated 1225 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:15:36.442375 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-90015557-0146-4f41-a26b-e1cc1cb0c614 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:15:36.443489 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-90015557-0146-4f41-a26b-e1cc1cb0c614 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] [instance: f2e7c278-8bf2-46c0-bc52-bc071ad88b64] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:15:36.450184 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-90015557-0146-4f41-a26b-e1cc1cb0c614 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:15:36.450630 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-90015557-0146-4f41-a26b-e1cc1cb0c614 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:15:36.451426 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-90015557-0146-4f41-a26b-e1cc1cb0c614 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:15:36.451865 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-90015557-0146-4f41-a26b-e1cc1cb0c614 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:15:36.466054 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.wsgi [None req-90015557-0146-4f41-a26b-e1cc1cb0c614 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] HTTP exception thrown: Instance f2e7c278-8bf2-46c0-bc52-bc071ad88b64 could not be found. Jul 01 04:15:36.467604 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-90015557-0146-4f41-a26b-e1cc1cb0c614 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Request method failure captured: Jul 01 04:15:36.467604 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: request: GET /compute/v2.1/servers/f2e7c278-8bf2-46c0-bc52-bc071ad88b64 HTTP/1.1 Jul 01 04:15:36.467604 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: Accept: application/json Jul 01 04:15:36.467604 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: Accept-Encoding: identity Jul 01 04:15:36.467604 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: Connection: close Jul 01 04:15:36.467604 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: Content-Length: 0 Jul 01 04:15:36.467604 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: Content-Type: application/json Jul 01 04:15:36.467604 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: Host: 10.222.0.20 Jul 01 04:15:36.467604 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: Openstack-System-Scope: None Jul 01 04:15:36.467604 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: User-Agent: python-urllib3/1.26.9 Jul 01 04:15:36.467604 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-Auth-Token: gAAAAABivnMVDnkvsZR1pUodfyab59-2FxPgIzqSSqWseKXFyEoXyxlQvSfd9brhIPPd_15UmMlAscx6_Cl9f-36cMkV8_zoTWEyLDWRvuRQ6Z9jOVIM3Ubo43CuoJkis1Gs_uQuS50KPC8FGWybd1JttX4ElDuMRxMmP5z2xlvPCIYdzGMBdpc Jul 01 04:15:36.467604 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-Domain-Id: None Jul 01 04:15:36.467604 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-Domain-Name: None Jul 01 04:15:36.467604 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-Identity-Status: Confirmed Jul 01 04:15:36.467604 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-Is-Admin-Project: True Jul 01 04:15:36.467604 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-Project-Domain-Id: default Jul 01 04:15:36.467604 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-Project-Domain-Name: Default Jul 01 04:15:36.467604 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-Project-Id: da99a87350634e9ea8a89f314f5e6118 Jul 01 04:15:36.467604 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-Project-Name: tempest-TestVolumeBootPattern-1248148891 Jul 01 04:15:36.467604 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-Role: reader,member Jul 01 04:15:36.467604 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-Roles: reader,member Jul 01 04:15:36.469764 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/da99a87350634e9ea8a89f314f5e6118"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_da99a87350634e9ea8a89f314f5e6118", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/da99a87350634e9ea8a89f314f5e6118"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/da99a87350634e9ea8a89f314f5e6118"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}] Jul 01 04:15:36.469764 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-Tenant: tempest-TestVolumeBootPattern-1248148891 Jul 01 04:15:36.469764 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-Tenant-Id: da99a87350634e9ea8a89f314f5e6118 Jul 01 04:15:36.469764 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-Tenant-Name: tempest-TestVolumeBootPattern-1248148891 Jul 01 04:15:36.469764 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-User: tempest-TestVolumeBootPattern-1248148891-project Jul 01 04:15:36.469764 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-User-Domain-Id: default Jul 01 04:15:36.469764 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-User-Domain-Name: Default Jul 01 04:15:36.469764 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-User-Id: 2e9707561b4a4811bd7a7d3fed4fcd6b Jul 01 04:15:36.469764 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-User-Name: tempest-TestVolumeBootPattern-1248148891-project Jul 01 04:15:36.469764 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: method: > Jul 01 04:15:36.469764 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: exception: Instance f2e7c278-8bf2-46c0-bc52-bc071ad88b64 could not be found. Jul 01 04:15:36.469764 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: action_args: {'id': 'f2e7c278-8bf2-46c0-bc52-bc071ad88b64'} Jul 01 04:15:36.470737 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 04:15:36.470737 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 04:15:36.470737 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 04:15:36.470737 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 04:15:36.470737 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 04:15:36.470737 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 04:15:36.470737 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 04:15:36.470737 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 04:15:36.470737 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 04:15:36.470737 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 04:15:36.470737 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f2e7c278-8bf2-46c0-bc52-bc071ad88b64 could not be found. Jul 01 04:15:36.470737 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi Jul 01 04:15:36.470737 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 04:15:36.470737 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi Jul 01 04:15:36.470737 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 04:15:36.470737 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 04:15:36.470737 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 04:15:36.470737 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 04:15:36.470737 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 04:15:36.470737 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 04:15:36.473213 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 04:15:36.473213 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 04:15:36.473213 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 04:15:36.473213 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 04:15:36.473213 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 04:15:36.473213 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 04:15:36.473213 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 04:15:36.473213 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f2e7c278-8bf2-46c0-bc52-bc071ad88b64 could not be found. Jul 01 04:15:36.473213 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi Jul 01 04:15:36.473213 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 04:15:36.473213 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi Jul 01 04:15:36.473213 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 04:15:36.473213 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 04:15:36.473213 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 04:15:36.473213 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 04:15:36.473213 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 04:15:36.473213 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f2e7c278-8bf2-46c0-bc52-bc071ad88b64 could not be found. Jul 01 04:15:36.473213 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi Jul 01 04:15:36.474560 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-90015557-0146-4f41-a26b-e1cc1cb0c614 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Returning 404 to user: Instance f2e7c278-8bf2-46c0-bc52-bc071ad88b64 could not be found. {{(pid=118711) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 04:15:36.474560 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-90015557-0146-4f41-a26b-e1cc1cb0c614 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] 10.222.0.20 "GET /compute/v2.1/servers/f2e7c278-8bf2-46c0-bc52-bc071ad88b64" status: 404 len: 111 microversion: 2.1 time: 0.031733 Jul 01 04:15:36.474560 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 471/952] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:15:36 2022] GET /compute/v2.1/servers/f2e7c278-8bf2-46c0-bc52-bc071ad88b64 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 04:15:40.025862 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-9ce65041-dde1-4540-a98a-f443c70eec66 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:15:40.026381 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-9ce65041-dde1-4540-a98a-f443c70eec66 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] [instance: aa92d51d-018c-4829-8e14-4af0f40692f7] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:15:40.033377 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [req-c0c90c3c-97e1-4cbb-800e-dae45ae94a06 req-f2866296-b301-4dbd-aea0-d216ad72ec55 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aa92d51d-018c-4829-8e14-4af0f40692f7", "tag": "5eb0498e-8bd6-446e-a109-b1dadf449fa9"}]} {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 04:15:40.045782 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [req-c0c90c3c-97e1-4cbb-800e-dae45ae94a06 req-f2866296-b301-4dbd-aea0-d216ad72ec55 service nova] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:15:40.046053 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-9ce65041-dde1-4540-a98a-f443c70eec66 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:15:40.046350 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-9ce65041-dde1-4540-a98a-f443c70eec66 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:15:40.047033 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-9ce65041-dde1-4540-a98a-f443c70eec66 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:15:40.047529 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [req-c0c90c3c-97e1-4cbb-800e-dae45ae94a06 req-f2866296-b301-4dbd-aea0-d216ad72ec55 service nova] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:15:40.047666 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-9ce65041-dde1-4540-a98a-f443c70eec66 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:15:40.066336 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.compute.server_external_events [req-c0c90c3c-97e1-4cbb-800e-dae45ae94a06 req-f2866296-b301-4dbd-aea0-d216ad72ec55 service nova] Creating event network-changed:5eb0498e-8bd6-446e-a109-b1dadf449fa9 for instance aa92d51d-018c-4829-8e14-4af0f40692f7 on hv-cinder-84684 Jul 01 04:15:40.074037 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [req-c0c90c3c-97e1-4cbb-800e-dae45ae94a06 req-f2866296-b301-4dbd-aea0-d216ad72ec55 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044644 Jul 01 04:15:40.075032 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-9ce65041-dde1-4540-a98a-f443c70eec66 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] [instance: aa92d51d-018c-4829-8e14-4af0f40692f7] Going to try to terminate instance {{(pid=118712) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 01 04:15:40.076425 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 472/953] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Jul 1 04:15:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 01 04:15:40.394416 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-9ce65041-dde1-4540-a98a-f443c70eec66 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] 10.222.0.20 "DELETE /compute/v2.1/servers/aa92d51d-018c-4829-8e14-4af0f40692f7" status: 204 len: 0 microversion: 2.1 time: 0.372097 Jul 01 04:15:40.395059 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 482/954] 10.222.0.20 () {58 vars in 1238 bytes} [Fri Jul 1 04:15:40 2022] DELETE /compute/v2.1/servers/aa92d51d-018c-4829-8e14-4af0f40692f7 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 01 04:15:40.403905 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-c34c08fb-676d-4cb4-8fee-ff57fe6228ae tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:15:40.404609 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-c34c08fb-676d-4cb4-8fee-ff57fe6228ae tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] [instance: aa92d51d-018c-4829-8e14-4af0f40692f7] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:15:40.411003 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-c34c08fb-676d-4cb4-8fee-ff57fe6228ae tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:15:40.411503 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-c34c08fb-676d-4cb4-8fee-ff57fe6228ae tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:15:40.412263 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-c34c08fb-676d-4cb4-8fee-ff57fe6228ae tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:15:40.412706 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-c34c08fb-676d-4cb4-8fee-ff57fe6228ae tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:15:40.559538 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-c34c08fb-676d-4cb4-8fee-ff57fe6228ae tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e9707561b4a4811bd7a7d3fed4fcd6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da99a87350634e9ea8a89f314f5e6118', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:15:40.567790 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-c34c08fb-676d-4cb4-8fee-ff57fe6228ae tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] 10.222.0.20 "GET /compute/v2.1/servers/aa92d51d-018c-4829-8e14-4af0f40692f7" status: 200 len: 1576 microversion: 2.1 time: 0.168079 Jul 01 04:15:40.568867 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 473/955] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:15:40 2022] GET /compute/v2.1/servers/aa92d51d-018c-4829-8e14-4af0f40692f7 => generated 1576 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:15:41.586428 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-ec226c39-def6-4622-96e2-4dbffa638d4a tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:15:41.587176 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-ec226c39-def6-4622-96e2-4dbffa638d4a tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] [instance: aa92d51d-018c-4829-8e14-4af0f40692f7] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:15:41.594071 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-ec226c39-def6-4622-96e2-4dbffa638d4a tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:15:41.594532 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-ec226c39-def6-4622-96e2-4dbffa638d4a tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:15:41.595358 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-ec226c39-def6-4622-96e2-4dbffa638d4a tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:15:41.595989 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-ec226c39-def6-4622-96e2-4dbffa638d4a tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:15:41.755560 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-ec226c39-def6-4622-96e2-4dbffa638d4a tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e9707561b4a4811bd7a7d3fed4fcd6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da99a87350634e9ea8a89f314f5e6118', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:15:41.766698 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-ec226c39-def6-4622-96e2-4dbffa638d4a tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] 10.222.0.20 "GET /compute/v2.1/servers/aa92d51d-018c-4829-8e14-4af0f40692f7" status: 200 len: 1576 microversion: 2.1 time: 0.184171 Jul 01 04:15:41.767591 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 483/956] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:15:41 2022] GET /compute/v2.1/servers/aa92d51d-018c-4829-8e14-4af0f40692f7 => generated 1576 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:15:42.785803 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-431b1abc-5155-4c7d-9f57-6d9e76b98602 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:15:42.786959 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-431b1abc-5155-4c7d-9f57-6d9e76b98602 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] [instance: aa92d51d-018c-4829-8e14-4af0f40692f7] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:15:42.791303 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [req-481260e8-88c5-419c-861e-d5640f17662e req-78be5b1d-3524-4ecd-bd79-4188b65e6e14 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa92d51d-018c-4829-8e14-4af0f40692f7", "name": "network-vif-deleted", "tag": "5eb0498e-8bd6-446e-a109-b1dadf449fa9"}]} {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 04:15:42.794440 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-431b1abc-5155-4c7d-9f57-6d9e76b98602 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:15:42.802109 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-431b1abc-5155-4c7d-9f57-6d9e76b98602 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:15:42.802109 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-431b1abc-5155-4c7d-9f57-6d9e76b98602 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:15:42.802109 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-431b1abc-5155-4c7d-9f57-6d9e76b98602 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:15:42.802626 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [req-481260e8-88c5-419c-861e-d5640f17662e req-78be5b1d-3524-4ecd-bd79-4188b65e6e14 service nova] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:15:42.803667 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [req-481260e8-88c5-419c-861e-d5640f17662e req-78be5b1d-3524-4ecd-bd79-4188b65e6e14 service nova] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:15:42.820393 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.compute.server_external_events [req-481260e8-88c5-419c-861e-d5640f17662e req-78be5b1d-3524-4ecd-bd79-4188b65e6e14 service nova] Creating event network-vif-deleted:5eb0498e-8bd6-446e-a109-b1dadf449fa9 for instance aa92d51d-018c-4829-8e14-4af0f40692f7 on hv-cinder-84684 Jul 01 04:15:42.826850 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [req-481260e8-88c5-419c-861e-d5640f17662e req-78be5b1d-3524-4ecd-bd79-4188b65e6e14 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041200 Jul 01 04:15:42.827517 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 484/957] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Jul 1 04:15:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 01 04:15:42.865600 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-431b1abc-5155-4c7d-9f57-6d9e76b98602 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e9707561b4a4811bd7a7d3fed4fcd6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da99a87350634e9ea8a89f314f5e6118', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:15:42.874749 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-431b1abc-5155-4c7d-9f57-6d9e76b98602 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] 10.222.0.20 "GET /compute/v2.1/servers/aa92d51d-018c-4829-8e14-4af0f40692f7" status: 200 len: 1391 microversion: 2.1 time: 0.093140 Jul 01 04:15:42.875339 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 474/958] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:15:42 2022] GET /compute/v2.1/servers/aa92d51d-018c-4829-8e14-4af0f40692f7 => generated 1391 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:15:43.894759 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-6ac18208-4a00-43ee-9949-79546be2bcfd tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:15:43.895483 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-6ac18208-4a00-43ee-9949-79546be2bcfd tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] [instance: aa92d51d-018c-4829-8e14-4af0f40692f7] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:15:43.901723 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-6ac18208-4a00-43ee-9949-79546be2bcfd tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:15:43.902172 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-6ac18208-4a00-43ee-9949-79546be2bcfd tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:15:43.902981 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-6ac18208-4a00-43ee-9949-79546be2bcfd tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:15:43.903481 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-6ac18208-4a00-43ee-9949-79546be2bcfd tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:15:43.936468 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-6ac18208-4a00-43ee-9949-79546be2bcfd tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:15:43.936927 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-6ac18208-4a00-43ee-9949-79546be2bcfd tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:15:43.937379 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.objects.instance [None req-6ac18208-4a00-43ee-9949-79546be2bcfd tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Lazy-loading 'fault' on Instance uuid aa92d51d-018c-4829-8e14-4af0f40692f7 {{(pid=118712) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 04:15:43.980815 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-6ac18208-4a00-43ee-9949-79546be2bcfd tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e9707561b4a4811bd7a7d3fed4fcd6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da99a87350634e9ea8a89f314f5e6118', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:15:43.988422 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-6ac18208-4a00-43ee-9949-79546be2bcfd tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] 10.222.0.20 "GET /compute/v2.1/servers/aa92d51d-018c-4829-8e14-4af0f40692f7" status: 200 len: 1230 microversion: 2.1 time: 0.099074 Jul 01 04:15:43.988994 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 485/959] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:15:43 2022] GET /compute/v2.1/servers/aa92d51d-018c-4829-8e14-4af0f40692f7 => generated 1230 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:15:45.008385 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-6301c763-b50f-4023-8ffa-92768902c526 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:15:45.009091 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-6301c763-b50f-4023-8ffa-92768902c526 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] [instance: aa92d51d-018c-4829-8e14-4af0f40692f7] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:15:45.016379 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-6301c763-b50f-4023-8ffa-92768902c526 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:15:45.019086 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-6301c763-b50f-4023-8ffa-92768902c526 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:15:45.019086 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-6301c763-b50f-4023-8ffa-92768902c526 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:15:45.019086 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-6301c763-b50f-4023-8ffa-92768902c526 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:15:45.032744 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.wsgi [None req-6301c763-b50f-4023-8ffa-92768902c526 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] HTTP exception thrown: Instance aa92d51d-018c-4829-8e14-4af0f40692f7 could not be found. Jul 01 04:15:45.034458 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-6301c763-b50f-4023-8ffa-92768902c526 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Request method failure captured: Jul 01 04:15:45.034458 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: request: GET /compute/v2.1/servers/aa92d51d-018c-4829-8e14-4af0f40692f7 HTTP/1.1 Jul 01 04:15:45.034458 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: Accept: application/json Jul 01 04:15:45.034458 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: Accept-Encoding: identity Jul 01 04:15:45.034458 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: Connection: close Jul 01 04:15:45.034458 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: Content-Length: 0 Jul 01 04:15:45.034458 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: Content-Type: application/json Jul 01 04:15:45.034458 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: Host: 10.222.0.20 Jul 01 04:15:45.034458 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: Openstack-System-Scope: None Jul 01 04:15:45.034458 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: User-Agent: python-urllib3/1.26.9 Jul 01 04:15:45.034458 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-Auth-Token: gAAAAABivnMVDnkvsZR1pUodfyab59-2FxPgIzqSSqWseKXFyEoXyxlQvSfd9brhIPPd_15UmMlAscx6_Cl9f-36cMkV8_zoTWEyLDWRvuRQ6Z9jOVIM3Ubo43CuoJkis1Gs_uQuS50KPC8FGWybd1JttX4ElDuMRxMmP5z2xlvPCIYdzGMBdpc Jul 01 04:15:45.034458 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-Domain-Id: None Jul 01 04:15:45.034458 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-Domain-Name: None Jul 01 04:15:45.034458 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-Identity-Status: Confirmed Jul 01 04:15:45.034458 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-Is-Admin-Project: True Jul 01 04:15:45.034458 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-Project-Domain-Id: default Jul 01 04:15:45.034458 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-Project-Domain-Name: Default Jul 01 04:15:45.034458 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-Project-Id: da99a87350634e9ea8a89f314f5e6118 Jul 01 04:15:45.034458 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-Project-Name: tempest-TestVolumeBootPattern-1248148891 Jul 01 04:15:45.034458 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-Role: reader,member Jul 01 04:15:45.034458 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-Roles: reader,member Jul 01 04:15:45.036142 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/da99a87350634e9ea8a89f314f5e6118"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_da99a87350634e9ea8a89f314f5e6118", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/da99a87350634e9ea8a89f314f5e6118"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/da99a87350634e9ea8a89f314f5e6118"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}] Jul 01 04:15:45.036142 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-Tenant: tempest-TestVolumeBootPattern-1248148891 Jul 01 04:15:45.036142 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-Tenant-Id: da99a87350634e9ea8a89f314f5e6118 Jul 01 04:15:45.036142 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-Tenant-Name: tempest-TestVolumeBootPattern-1248148891 Jul 01 04:15:45.036142 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-User: tempest-TestVolumeBootPattern-1248148891-project Jul 01 04:15:45.036142 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-User-Domain-Id: default Jul 01 04:15:45.036142 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-User-Domain-Name: Default Jul 01 04:15:45.036142 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-User-Id: 2e9707561b4a4811bd7a7d3fed4fcd6b Jul 01 04:15:45.036142 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-User-Name: tempest-TestVolumeBootPattern-1248148891-project Jul 01 04:15:45.036142 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: method: > Jul 01 04:15:45.036142 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: exception: Instance aa92d51d-018c-4829-8e14-4af0f40692f7 could not be found. Jul 01 04:15:45.036142 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: action_args: {'id': 'aa92d51d-018c-4829-8e14-4af0f40692f7'} Jul 01 04:15:45.037028 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 04:15:45.037028 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 04:15:45.037028 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 04:15:45.037028 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 04:15:45.037028 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 04:15:45.037028 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 04:15:45.037028 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 04:15:45.037028 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 04:15:45.037028 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 04:15:45.037028 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 04:15:45.037028 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aa92d51d-018c-4829-8e14-4af0f40692f7 could not be found. Jul 01 04:15:45.037028 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi Jul 01 04:15:45.037028 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 04:15:45.037028 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi Jul 01 04:15:45.037028 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 04:15:45.037028 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 04:15:45.037028 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 04:15:45.037028 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 04:15:45.037028 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 04:15:45.037028 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 04:15:45.038567 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 04:15:45.038567 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 04:15:45.038567 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 04:15:45.038567 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 04:15:45.038567 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 04:15:45.038567 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 04:15:45.038567 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 04:15:45.038567 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aa92d51d-018c-4829-8e14-4af0f40692f7 could not be found. Jul 01 04:15:45.038567 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi Jul 01 04:15:45.038567 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 04:15:45.038567 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi Jul 01 04:15:45.038567 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 04:15:45.038567 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 04:15:45.038567 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 04:15:45.038567 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 04:15:45.038567 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 04:15:45.038567 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aa92d51d-018c-4829-8e14-4af0f40692f7 could not be found. Jul 01 04:15:45.038567 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi Jul 01 04:15:45.045938 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-6301c763-b50f-4023-8ffa-92768902c526 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Returning 404 to user: Instance aa92d51d-018c-4829-8e14-4af0f40692f7 could not be found. {{(pid=118711) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 04:15:45.045938 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-6301c763-b50f-4023-8ffa-92768902c526 tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] 10.222.0.20 "GET /compute/v2.1/servers/aa92d51d-018c-4829-8e14-4af0f40692f7" status: 404 len: 111 microversion: 2.1 time: 0.031521 Jul 01 04:15:45.045938 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 475/960] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:15:45 2022] GET /compute/v2.1/servers/aa92d51d-018c-4829-8e14-4af0f40692f7 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 04:15:45.536314 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-d31895dc-ff6e-49f3-a7e0-f310abfbcc0a tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:15:45.536814 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-d31895dc-ff6e-49f3-a7e0-f310abfbcc0a tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] [instance: 246ef166-ec68-4657-b7b2-529c41cb4429] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:15:45.543451 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-d31895dc-ff6e-49f3-a7e0-f310abfbcc0a tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:15:45.543927 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-d31895dc-ff6e-49f3-a7e0-f310abfbcc0a tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:15:45.544698 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-d31895dc-ff6e-49f3-a7e0-f310abfbcc0a tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:15:45.545134 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-d31895dc-ff6e-49f3-a7e0-f310abfbcc0a tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:15:45.558853 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.wsgi [None req-d31895dc-ff6e-49f3-a7e0-f310abfbcc0a tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] HTTP exception thrown: Instance 246ef166-ec68-4657-b7b2-529c41cb4429 could not be found. Jul 01 04:15:45.560549 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-d31895dc-ff6e-49f3-a7e0-f310abfbcc0a tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Request method failure captured: Jul 01 04:15:45.560549 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: request: DELETE /compute/v2.1/servers/246ef166-ec68-4657-b7b2-529c41cb4429 HTTP/1.1 Jul 01 04:15:45.560549 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: Accept: application/json Jul 01 04:15:45.560549 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: Accept-Encoding: identity Jul 01 04:15:45.560549 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: Connection: close Jul 01 04:15:45.560549 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: Content-Length: 0 Jul 01 04:15:45.560549 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: Content-Type: application/json Jul 01 04:15:45.560549 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: Host: 10.222.0.20 Jul 01 04:15:45.560549 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: Openstack-System-Scope: None Jul 01 04:15:45.560549 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: User-Agent: python-urllib3/1.26.9 Jul 01 04:15:45.560549 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Auth-Token: gAAAAABivnMVDnkvsZR1pUodfyab59-2FxPgIzqSSqWseKXFyEoXyxlQvSfd9brhIPPd_15UmMlAscx6_Cl9f-36cMkV8_zoTWEyLDWRvuRQ6Z9jOVIM3Ubo43CuoJkis1Gs_uQuS50KPC8FGWybd1JttX4ElDuMRxMmP5z2xlvPCIYdzGMBdpc Jul 01 04:15:45.560549 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Domain-Id: None Jul 01 04:15:45.560549 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Domain-Name: None Jul 01 04:15:45.560549 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Identity-Status: Confirmed Jul 01 04:15:45.560549 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Is-Admin-Project: True Jul 01 04:15:45.560549 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Project-Domain-Id: default Jul 01 04:15:45.560549 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Project-Domain-Name: Default Jul 01 04:15:45.560549 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Project-Id: da99a87350634e9ea8a89f314f5e6118 Jul 01 04:15:45.560549 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Project-Name: tempest-TestVolumeBootPattern-1248148891 Jul 01 04:15:45.560549 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Role: reader,member Jul 01 04:15:45.560549 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Roles: reader,member Jul 01 04:15:45.562108 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/da99a87350634e9ea8a89f314f5e6118"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_da99a87350634e9ea8a89f314f5e6118", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/da99a87350634e9ea8a89f314f5e6118"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/da99a87350634e9ea8a89f314f5e6118"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}] Jul 01 04:15:45.562108 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Tenant: tempest-TestVolumeBootPattern-1248148891 Jul 01 04:15:45.562108 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Tenant-Id: da99a87350634e9ea8a89f314f5e6118 Jul 01 04:15:45.562108 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Tenant-Name: tempest-TestVolumeBootPattern-1248148891 Jul 01 04:15:45.562108 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-User: tempest-TestVolumeBootPattern-1248148891-project Jul 01 04:15:45.562108 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-User-Domain-Id: default Jul 01 04:15:45.562108 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-User-Domain-Name: Default Jul 01 04:15:45.562108 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-User-Id: 2e9707561b4a4811bd7a7d3fed4fcd6b Jul 01 04:15:45.562108 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-User-Name: tempest-TestVolumeBootPattern-1248148891-project Jul 01 04:15:45.562108 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: method: > Jul 01 04:15:45.562108 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: exception: Instance 246ef166-ec68-4657-b7b2-529c41cb4429 could not be found. Jul 01 04:15:45.562108 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: action_args: {'id': '246ef166-ec68-4657-b7b2-529c41cb4429'} Jul 01 04:15:45.562846 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 04:15:45.562846 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 04:15:45.562846 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 04:15:45.562846 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 04:15:45.562846 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 04:15:45.562846 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 04:15:45.562846 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 04:15:45.562846 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 04:15:45.562846 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 04:15:45.562846 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 04:15:45.562846 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 246ef166-ec68-4657-b7b2-529c41cb4429 could not be found. Jul 01 04:15:45.562846 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi Jul 01 04:15:45.562846 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 04:15:45.562846 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi Jul 01 04:15:45.562846 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 04:15:45.562846 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 04:15:45.562846 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 04:15:45.562846 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 04:15:45.562846 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 04:15:45.562846 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 04:15:45.564745 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 04:15:45.564745 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 01 04:15:45.564745 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 01 04:15:45.564745 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 01 04:15:45.564745 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 01 04:15:45.564745 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 04:15:45.564745 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 04:15:45.564745 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 04:15:45.564745 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 04:15:45.564745 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 246ef166-ec68-4657-b7b2-529c41cb4429 could not be found. Jul 01 04:15:45.564745 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi Jul 01 04:15:45.564745 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 04:15:45.564745 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi Jul 01 04:15:45.564745 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 04:15:45.564745 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 04:15:45.564745 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 04:15:45.564745 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 04:15:45.564745 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 04:15:45.564745 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 246ef166-ec68-4657-b7b2-529c41cb4429 could not be found. Jul 01 04:15:45.564745 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi Jul 01 04:15:45.566418 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-d31895dc-ff6e-49f3-a7e0-f310abfbcc0a tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Returning 404 to user: Instance 246ef166-ec68-4657-b7b2-529c41cb4429 could not be found. {{(pid=118712) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 04:15:45.566418 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-d31895dc-ff6e-49f3-a7e0-f310abfbcc0a tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] 10.222.0.20 "DELETE /compute/v2.1/servers/246ef166-ec68-4657-b7b2-529c41cb4429" status: 404 len: 111 microversion: 2.1 time: 0.030155 Jul 01 04:15:45.566418 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 486/961] 10.222.0.20 () {58 vars in 1238 bytes} [Fri Jul 1 04:15:45 2022] DELETE /compute/v2.1/servers/246ef166-ec68-4657-b7b2-529c41cb4429 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 04:15:45.571366 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-0737cc88-3b43-40d0-8769-cc6b254c51eb tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:15:45.571975 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-0737cc88-3b43-40d0-8769-cc6b254c51eb tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] [instance: 246ef166-ec68-4657-b7b2-529c41cb4429] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:15:45.580140 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-0737cc88-3b43-40d0-8769-cc6b254c51eb tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:15:45.580598 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-0737cc88-3b43-40d0-8769-cc6b254c51eb tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:15:45.584253 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-0737cc88-3b43-40d0-8769-cc6b254c51eb tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:15:45.584253 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-0737cc88-3b43-40d0-8769-cc6b254c51eb tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:15:45.595127 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.wsgi [None req-0737cc88-3b43-40d0-8769-cc6b254c51eb tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] HTTP exception thrown: Instance 246ef166-ec68-4657-b7b2-529c41cb4429 could not be found. Jul 01 04:15:45.596663 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-0737cc88-3b43-40d0-8769-cc6b254c51eb tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Request method failure captured: Jul 01 04:15:45.596663 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: request: GET /compute/v2.1/servers/246ef166-ec68-4657-b7b2-529c41cb4429 HTTP/1.1 Jul 01 04:15:45.596663 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: Accept: application/json Jul 01 04:15:45.596663 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: Accept-Encoding: identity Jul 01 04:15:45.596663 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: Connection: close Jul 01 04:15:45.596663 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: Content-Length: 0 Jul 01 04:15:45.596663 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: Content-Type: application/json Jul 01 04:15:45.596663 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: Host: 10.222.0.20 Jul 01 04:15:45.596663 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: Openstack-System-Scope: None Jul 01 04:15:45.596663 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: User-Agent: python-urllib3/1.26.9 Jul 01 04:15:45.596663 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-Auth-Token: gAAAAABivnMVDnkvsZR1pUodfyab59-2FxPgIzqSSqWseKXFyEoXyxlQvSfd9brhIPPd_15UmMlAscx6_Cl9f-36cMkV8_zoTWEyLDWRvuRQ6Z9jOVIM3Ubo43CuoJkis1Gs_uQuS50KPC8FGWybd1JttX4ElDuMRxMmP5z2xlvPCIYdzGMBdpc Jul 01 04:15:45.596663 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-Domain-Id: None Jul 01 04:15:45.596663 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-Domain-Name: None Jul 01 04:15:45.596663 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-Identity-Status: Confirmed Jul 01 04:15:45.596663 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-Is-Admin-Project: True Jul 01 04:15:45.596663 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-Project-Domain-Id: default Jul 01 04:15:45.596663 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-Project-Domain-Name: Default Jul 01 04:15:45.596663 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-Project-Id: da99a87350634e9ea8a89f314f5e6118 Jul 01 04:15:45.596663 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-Project-Name: tempest-TestVolumeBootPattern-1248148891 Jul 01 04:15:45.596663 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-Role: reader,member Jul 01 04:15:45.596663 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-Roles: reader,member Jul 01 04:15:45.598303 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/da99a87350634e9ea8a89f314f5e6118"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_da99a87350634e9ea8a89f314f5e6118", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/da99a87350634e9ea8a89f314f5e6118"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/da99a87350634e9ea8a89f314f5e6118"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}] Jul 01 04:15:45.598303 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-Tenant: tempest-TestVolumeBootPattern-1248148891 Jul 01 04:15:45.598303 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-Tenant-Id: da99a87350634e9ea8a89f314f5e6118 Jul 01 04:15:45.598303 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-Tenant-Name: tempest-TestVolumeBootPattern-1248148891 Jul 01 04:15:45.598303 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-User: tempest-TestVolumeBootPattern-1248148891-project Jul 01 04:15:45.598303 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-User-Domain-Id: default Jul 01 04:15:45.598303 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-User-Domain-Name: Default Jul 01 04:15:45.598303 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-User-Id: 2e9707561b4a4811bd7a7d3fed4fcd6b Jul 01 04:15:45.598303 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-User-Name: tempest-TestVolumeBootPattern-1248148891-project Jul 01 04:15:45.598303 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: method: > Jul 01 04:15:45.598303 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: exception: Instance 246ef166-ec68-4657-b7b2-529c41cb4429 could not be found. Jul 01 04:15:45.598303 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: action_args: {'id': '246ef166-ec68-4657-b7b2-529c41cb4429'} Jul 01 04:15:45.599213 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 04:15:45.599213 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 04:15:45.599213 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 04:15:45.599213 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 04:15:45.599213 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 04:15:45.599213 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 04:15:45.599213 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 04:15:45.599213 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 04:15:45.599213 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 04:15:45.599213 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 04:15:45.599213 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 246ef166-ec68-4657-b7b2-529c41cb4429 could not be found. Jul 01 04:15:45.599213 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi Jul 01 04:15:45.599213 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 04:15:45.599213 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi Jul 01 04:15:45.599213 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 04:15:45.599213 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 04:15:45.599213 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 04:15:45.599213 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 04:15:45.599213 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 04:15:45.599213 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 04:15:45.600711 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 04:15:45.600711 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 04:15:45.600711 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 04:15:45.600711 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 04:15:45.600711 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 04:15:45.600711 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 04:15:45.600711 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 04:15:45.600711 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 246ef166-ec68-4657-b7b2-529c41cb4429 could not be found. Jul 01 04:15:45.600711 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi Jul 01 04:15:45.600711 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 04:15:45.600711 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi Jul 01 04:15:45.600711 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 04:15:45.600711 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 04:15:45.600711 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 04:15:45.600711 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 04:15:45.600711 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 04:15:45.600711 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 246ef166-ec68-4657-b7b2-529c41cb4429 could not be found. Jul 01 04:15:45.600711 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi Jul 01 04:15:45.602057 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-0737cc88-3b43-40d0-8769-cc6b254c51eb tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Returning 404 to user: Instance 246ef166-ec68-4657-b7b2-529c41cb4429 could not be found. {{(pid=118711) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 04:15:45.602057 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-0737cc88-3b43-40d0-8769-cc6b254c51eb tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] 10.222.0.20 "GET /compute/v2.1/servers/246ef166-ec68-4657-b7b2-529c41cb4429" status: 404 len: 111 microversion: 2.1 time: 0.030801 Jul 01 04:15:45.602057 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 476/962] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:15:45 2022] GET /compute/v2.1/servers/246ef166-ec68-4657-b7b2-529c41cb4429 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 04:15:47.111972 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-61893b9b-4da7-4087-8c07-b8fd872bb6db tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] Calling method '.version_select at 0x7f99a0754af0>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:15:47.188137 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-61893b9b-4da7-4087-8c07-b8fd872bb6db tempest-TestVolumeBootPattern-1248148891 tempest-TestVolumeBootPattern-1248148891-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1409661036" status: 202 len: 0 microversion: 2.1 time: 0.080009 Jul 01 04:15:47.189206 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 487/963] 10.222.0.20 () {58 vars in 1262 bytes} [Fri Jul 1 04:15:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1409661036 => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 04:16:00.136491 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-0b306b76-ce16-4e49-ad28-074d7fc5306c tempest-VolumesActionsTest-1466645267 tempest-VolumesActionsTest-1466645267-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-542479173", "imageRef": "66f9f4ba-339c-4967-8857-d65299a66629", "flavorRef": "452", "networks": [{"uuid": "fd264d76-83a6-4983-9c77-21f003ca1527"}]}} {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 04:16:00.144221 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG dbcounter [-] [118711] Writing DB stats nova_api:SELECT=15 {{(pid=118711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:16:00.144863 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG dbcounter [-] [118711] Writing DB stats nova_cell1:SELECT=58,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:16:00.189397 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.network.neutron [None req-0b306b76-ce16-4e49-ad28-074d7fc5306c tempest-VolumesActionsTest-1466645267 tempest-VolumesActionsTest-1466645267-project] validate_networks() for [('fd264d76-83a6-4983-9c77-21f003ca1527', None, None, None, None, None)] {{(pid=118711) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 01 04:16:00.598303 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.virt.hardware [None req-0b306b76-ce16-4e49-ad28-074d7fc5306c tempest-VolumesActionsTest-1466645267 tempest-VolumesActionsTest-1466645267-project] Flavor limits 0:0:0 {{(pid=118711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 01 04:16:00.598749 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.virt.hardware [None req-0b306b76-ce16-4e49-ad28-074d7fc5306c tempest-VolumesActionsTest-1466645267 tempest-VolumesActionsTest-1466645267-project] Image limits 0:0:0 {{(pid=118711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 01 04:16:00.599248 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.virt.hardware [None req-0b306b76-ce16-4e49-ad28-074d7fc5306c tempest-VolumesActionsTest-1466645267 tempest-VolumesActionsTest-1466645267-project] Flavor pref 0:0:0 {{(pid=118711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 01 04:16:00.599674 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.virt.hardware [None req-0b306b76-ce16-4e49-ad28-074d7fc5306c tempest-VolumesActionsTest-1466645267 tempest-VolumesActionsTest-1466645267-project] Image pref 0:0:0 {{(pid=118711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 01 04:16:00.600085 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.virt.hardware [None req-0b306b76-ce16-4e49-ad28-074d7fc5306c tempest-VolumesActionsTest-1466645267 tempest-VolumesActionsTest-1466645267-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 01 04:16:00.609298 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-0b306b76-ce16-4e49-ad28-074d7fc5306c tempest-VolumesActionsTest-1466645267 tempest-VolumesActionsTest-1466645267-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:16:00.609753 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-0b306b76-ce16-4e49-ad28-074d7fc5306c tempest-VolumesActionsTest-1466645267 tempest-VolumesActionsTest-1466645267-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:16:00.610563 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-0b306b76-ce16-4e49-ad28-074d7fc5306c tempest-VolumesActionsTest-1466645267 tempest-VolumesActionsTest-1466645267-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:16:00.611006 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-0b306b76-ce16-4e49-ad28-074d7fc5306c tempest-VolumesActionsTest-1466645267 tempest-VolumesActionsTest-1466645267-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:16:00.627570 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.quota [None req-0b306b76-ce16-4e49-ad28-074d7fc5306c tempest-VolumesActionsTest-1466645267 tempest-VolumesActionsTest-1466645267-project] Getting quotas for project a9f7e5a8b43740ab8cd82b939a8af457. Resources: {'ram', 'cores', 'instances'} {{(pid=118711) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 04:16:00.632052 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.quota [None req-0b306b76-ce16-4e49-ad28-074d7fc5306c tempest-VolumesActionsTest-1466645267 tempest-VolumesActionsTest-1466645267-project] Getting quotas for user 90fc6c2d12f3420eb7d646d7fceb8965 and project a9f7e5a8b43740ab8cd82b939a8af457. Resources: {'ram', 'cores', 'instances'} {{(pid=118711) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 04:16:00.643012 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-0b306b76-ce16-4e49-ad28-074d7fc5306c tempest-VolumesActionsTest-1466645267 tempest-VolumesActionsTest-1466645267-project] Going to run 1 instances... {{(pid=118711) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 01 04:16:00.645888 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-0b306b76-ce16-4e49-ad28-074d7fc5306c tempest-VolumesActionsTest-1466645267 tempest-VolumesActionsTest-1466645267-project] [instance: 78102129-cae3-4674-852a-798d0c8a732d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='66f9f4ba-339c-4967-8857-d65299a66629',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118711) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 01 04:16:00.743298 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-0b306b76-ce16-4e49-ad28-074d7fc5306c tempest-VolumesActionsTest-1466645267 tempest-VolumesActionsTest-1466645267-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.610640 Jul 01 04:16:00.743944 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 477/964] 10.222.0.20 () {60 vars in 1146 bytes} [Fri Jul 1 04:16:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 612 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 01 04:16:00.751593 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG dbcounter [-] [118712] Writing DB stats nova_cell1:SELECT=62,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:16:00.752426 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG dbcounter [-] [118712] Writing DB stats nova_api:SELECT=29,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=118712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:16:00.756727 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-768bf74f-7c87-4cec-99d1-f1ff116afc70 tempest-VolumesActionsTest-1466645267 tempest-VolumesActionsTest-1466645267-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:16:00.757340 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-768bf74f-7c87-4cec-99d1-f1ff116afc70 tempest-VolumesActionsTest-1466645267 tempest-VolumesActionsTest-1466645267-project] [instance: 78102129-cae3-4674-852a-798d0c8a732d] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:16:00.816194 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-768bf74f-7c87-4cec-99d1-f1ff116afc70 tempest-VolumesActionsTest-1466645267 tempest-VolumesActionsTest-1466645267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90fc6c2d12f3420eb7d646d7fceb8965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f7e5a8b43740ab8cd82b939a8af457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:16:00.823403 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-768bf74f-7c87-4cec-99d1-f1ff116afc70 tempest-VolumesActionsTest-1466645267 tempest-VolumesActionsTest-1466645267-project] 10.222.0.20 "GET /compute/v2.1/servers/78102129-cae3-4674-852a-798d0c8a732d" status: 200 len: 1213 microversion: 2.1 time: 0.073306 Jul 01 04:16:00.823978 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 488/965] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:16:00 2022] GET /compute/v2.1/servers/78102129-cae3-4674-852a-798d0c8a732d => generated 1213 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 04:16:01.840112 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-4bd42640-d135-46b6-8f45-363f5adb8a1a tempest-VolumesActionsTest-1466645267 tempest-VolumesActionsTest-1466645267-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:16:01.840675 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-4bd42640-d135-46b6-8f45-363f5adb8a1a tempest-VolumesActionsTest-1466645267 tempest-VolumesActionsTest-1466645267-project] [instance: 78102129-cae3-4674-852a-798d0c8a732d] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:16:01.850589 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-4bd42640-d135-46b6-8f45-363f5adb8a1a tempest-VolumesActionsTest-1466645267 tempest-VolumesActionsTest-1466645267-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:16:01.851041 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-4bd42640-d135-46b6-8f45-363f5adb8a1a tempest-VolumesActionsTest-1466645267 tempest-VolumesActionsTest-1466645267-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:16:01.851852 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-4bd42640-d135-46b6-8f45-363f5adb8a1a tempest-VolumesActionsTest-1466645267 tempest-VolumesActionsTest-1466645267-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:16:01.852273 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-4bd42640-d135-46b6-8f45-363f5adb8a1a tempest-VolumesActionsTest-1466645267 tempest-VolumesActionsTest-1466645267-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:16:01.915802 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-4bd42640-d135-46b6-8f45-363f5adb8a1a tempest-VolumesActionsTest-1466645267 tempest-VolumesActionsTest-1466645267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90fc6c2d12f3420eb7d646d7fceb8965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f7e5a8b43740ab8cd82b939a8af457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:16:01.932264 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-4bd42640-d135-46b6-8f45-363f5adb8a1a tempest-VolumesActionsTest-1466645267 tempest-VolumesActionsTest-1466645267-project] 10.222.0.20 "GET /compute/v2.1/servers/78102129-cae3-4674-852a-798d0c8a732d" status: 200 len: 1217 microversion: 2.1 time: 0.086941 Jul 01 04:16:01.932264 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 478/966] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:16:01 2022] GET /compute/v2.1/servers/78102129-cae3-4674-852a-798d0c8a732d => generated 1217 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:16:02.939876 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-17bf95da-c91d-419c-9c9c-d93fd7abd55d tempest-VolumesActionsTest-1466645267 tempest-VolumesActionsTest-1466645267-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:16:02.940480 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-17bf95da-c91d-419c-9c9c-d93fd7abd55d tempest-VolumesActionsTest-1466645267 tempest-VolumesActionsTest-1466645267-project] [instance: 78102129-cae3-4674-852a-798d0c8a732d] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:16:02.947894 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-17bf95da-c91d-419c-9c9c-d93fd7abd55d tempest-VolumesActionsTest-1466645267 tempest-VolumesActionsTest-1466645267-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:16:02.948336 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-17bf95da-c91d-419c-9c9c-d93fd7abd55d tempest-VolumesActionsTest-1466645267 tempest-VolumesActionsTest-1466645267-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:16:02.949091 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-17bf95da-c91d-419c-9c9c-d93fd7abd55d tempest-VolumesActionsTest-1466645267 tempest-VolumesActionsTest-1466645267-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:16:02.949618 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-17bf95da-c91d-419c-9c9c-d93fd7abd55d tempest-VolumesActionsTest-1466645267 tempest-VolumesActionsTest-1466645267-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:16:03.013401 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-17bf95da-c91d-419c-9c9c-d93fd7abd55d tempest-VolumesActionsTest-1466645267 tempest-VolumesActionsTest-1466645267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90fc6c2d12f3420eb7d646d7fceb8965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f7e5a8b43740ab8cd82b939a8af457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:16:03.021585 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-17bf95da-c91d-419c-9c9c-d93fd7abd55d tempest-VolumesActionsTest-1466645267 tempest-VolumesActionsTest-1466645267-project] 10.222.0.20 "GET /compute/v2.1/servers/78102129-cae3-4674-852a-798d0c8a732d" status: 200 len: 1265 microversion: 2.1 time: 0.085782 Jul 01 04:16:03.027891 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 489/967] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:16:02 2022] GET /compute/v2.1/servers/78102129-cae3-4674-852a-798d0c8a732d => generated 1265 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:16:04.038639 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-bf586577-c5ba-4b11-b812-15b6db3decf7 tempest-VolumesActionsTest-1466645267 tempest-VolumesActionsTest-1466645267-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:16:04.039287 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-bf586577-c5ba-4b11-b812-15b6db3decf7 tempest-VolumesActionsTest-1466645267 tempest-VolumesActionsTest-1466645267-project] [instance: 78102129-cae3-4674-852a-798d0c8a732d] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:16:04.046657 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-bf586577-c5ba-4b11-b812-15b6db3decf7 tempest-VolumesActionsTest-1466645267 tempest-VolumesActionsTest-1466645267-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:16:04.047112 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-bf586577-c5ba-4b11-b812-15b6db3decf7 tempest-VolumesActionsTest-1466645267 tempest-VolumesActionsTest-1466645267-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:16:04.047948 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-bf586577-c5ba-4b11-b812-15b6db3decf7 tempest-VolumesActionsTest-1466645267 tempest-VolumesActionsTest-1466645267-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:16:04.048393 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-bf586577-c5ba-4b11-b812-15b6db3decf7 tempest-VolumesActionsTest-1466645267 tempest-VolumesActionsTest-1466645267-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:16:04.251552 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-bf586577-c5ba-4b11-b812-15b6db3decf7 tempest-VolumesActionsTest-1466645267 tempest-VolumesActionsTest-1466645267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90fc6c2d12f3420eb7d646d7fceb8965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f7e5a8b43740ab8cd82b939a8af457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:16:04.259399 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-bf586577-c5ba-4b11-b812-15b6db3decf7 tempest-VolumesActionsTest-1466645267 tempest-VolumesActionsTest-1466645267-project] 10.222.0.20 "GET /compute/v2.1/servers/78102129-cae3-4674-852a-798d0c8a732d" status: 200 len: 1313 microversion: 2.1 time: 0.225298 Jul 01 04:16:04.260170 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 479/968] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:16:04 2022] GET /compute/v2.1/servers/78102129-cae3-4674-852a-798d0c8a732d => generated 1313 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:16:04.716288 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [req-95c30947-c945-429b-9349-3ee1dc063409 req-ec11bf69-38b1-4ddb-af21-787cada94afe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "78102129-cae3-4674-852a-798d0c8a732d", "tag": "f21cfe59-9373-43e9-91d6-68aaba681006"}]} {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 04:16:04.727764 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [req-95c30947-c945-429b-9349-3ee1dc063409 req-ec11bf69-38b1-4ddb-af21-787cada94afe service nova] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:16:04.727764 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [req-95c30947-c945-429b-9349-3ee1dc063409 req-ec11bf69-38b1-4ddb-af21-787cada94afe service nova] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:16:04.737637 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.compute.server_external_events [req-95c30947-c945-429b-9349-3ee1dc063409 req-ec11bf69-38b1-4ddb-af21-787cada94afe service nova] Creating event network-changed:f21cfe59-9373-43e9-91d6-68aaba681006 for instance 78102129-cae3-4674-852a-798d0c8a732d on hv-cinder-84684 Jul 01 04:16:04.743428 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [req-95c30947-c945-429b-9349-3ee1dc063409 req-ec11bf69-38b1-4ddb-af21-787cada94afe service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030878 Jul 01 04:16:04.748172 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 490/969] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Jul 1 04:16:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 04:16:05.277357 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-09429f85-6044-4382-8752-eb2f0f407468 tempest-VolumesActionsTest-1466645267 tempest-VolumesActionsTest-1466645267-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:16:05.277909 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-09429f85-6044-4382-8752-eb2f0f407468 tempest-VolumesActionsTest-1466645267 tempest-VolumesActionsTest-1466645267-project] [instance: 78102129-cae3-4674-852a-798d0c8a732d] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:16:05.284573 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-09429f85-6044-4382-8752-eb2f0f407468 tempest-VolumesActionsTest-1466645267 tempest-VolumesActionsTest-1466645267-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:16:05.285028 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-09429f85-6044-4382-8752-eb2f0f407468 tempest-VolumesActionsTest-1466645267 tempest-VolumesActionsTest-1466645267-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:16:05.285810 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-09429f85-6044-4382-8752-eb2f0f407468 tempest-VolumesActionsTest-1466645267 tempest-VolumesActionsTest-1466645267-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:16:05.286249 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-09429f85-6044-4382-8752-eb2f0f407468 tempest-VolumesActionsTest-1466645267 tempest-VolumesActionsTest-1466645267-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:16:05.497909 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-09429f85-6044-4382-8752-eb2f0f407468 tempest-VolumesActionsTest-1466645267 tempest-VolumesActionsTest-1466645267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90fc6c2d12f3420eb7d646d7fceb8965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f7e5a8b43740ab8cd82b939a8af457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:16:05.505431 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-09429f85-6044-4382-8752-eb2f0f407468 tempest-VolumesActionsTest-1466645267 tempest-VolumesActionsTest-1466645267-project] 10.222.0.20 "GET /compute/v2.1/servers/78102129-cae3-4674-852a-798d0c8a732d" status: 200 len: 1313 microversion: 2.1 time: 0.232068 Jul 01 04:16:05.506044 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 480/970] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:16:05 2022] GET /compute/v2.1/servers/78102129-cae3-4674-852a-798d0c8a732d => generated 1313 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:16:06.523399 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-a5426be3-213f-451e-8fd6-e7a846acaf56 tempest-VolumesActionsTest-1466645267 tempest-VolumesActionsTest-1466645267-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:16:06.524105 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-a5426be3-213f-451e-8fd6-e7a846acaf56 tempest-VolumesActionsTest-1466645267 tempest-VolumesActionsTest-1466645267-project] [instance: 78102129-cae3-4674-852a-798d0c8a732d] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:16:06.530842 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-a5426be3-213f-451e-8fd6-e7a846acaf56 tempest-VolumesActionsTest-1466645267 tempest-VolumesActionsTest-1466645267-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:16:06.531326 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-a5426be3-213f-451e-8fd6-e7a846acaf56 tempest-VolumesActionsTest-1466645267 tempest-VolumesActionsTest-1466645267-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:16:06.532104 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-a5426be3-213f-451e-8fd6-e7a846acaf56 tempest-VolumesActionsTest-1466645267 tempest-VolumesActionsTest-1466645267-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:16:06.532552 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-a5426be3-213f-451e-8fd6-e7a846acaf56 tempest-VolumesActionsTest-1466645267 tempest-VolumesActionsTest-1466645267-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:16:06.664721 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-a5426be3-213f-451e-8fd6-e7a846acaf56 tempest-VolumesActionsTest-1466645267 tempest-VolumesActionsTest-1466645267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90fc6c2d12f3420eb7d646d7fceb8965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f7e5a8b43740ab8cd82b939a8af457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:16:06.672114 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-a5426be3-213f-451e-8fd6-e7a846acaf56 tempest-VolumesActionsTest-1466645267 tempest-VolumesActionsTest-1466645267-project] 10.222.0.20 "GET /compute/v2.1/servers/78102129-cae3-4674-852a-798d0c8a732d" status: 200 len: 1313 microversion: 2.1 time: 0.153610 Jul 01 04:16:06.672673 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 491/971] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:16:06 2022] GET /compute/v2.1/servers/78102129-cae3-4674-852a-798d0c8a732d => generated 1313 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:16:07.494613 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-43cb6139-af04-44f0-b0ea-a5c5133f0c50 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:16:07.495184 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-43cb6139-af04-44f0-b0ea-a5c5133f0c50 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] [instance: 20264c61-166b-4dce-9121-d530cedf677f] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:16:07.501633 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-43cb6139-af04-44f0-b0ea-a5c5133f0c50 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:16:07.502258 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-43cb6139-af04-44f0-b0ea-a5c5133f0c50 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:16:07.503025 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-43cb6139-af04-44f0-b0ea-a5c5133f0c50 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:16:07.503499 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-43cb6139-af04-44f0-b0ea-a5c5133f0c50 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:16:07.526918 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-43cb6139-af04-44f0-b0ea-a5c5133f0c50 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] 10.222.0.20 "GET /compute/v2.1/servers/20264c61-166b-4dce-9121-d530cedf677f/ips" status: 200 len: 145 microversion: 2.1 time: 0.036671 Jul 01 04:16:07.527524 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 481/972] 10.222.0.20 () {58 vars in 1247 bytes} [Fri Jul 1 04:16:07 2022] GET /compute/v2.1/servers/20264c61-166b-4dce-9121-d530cedf677f/ips => generated 145 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 01 04:16:07.688883 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-5910b4d2-e6fc-4109-a2e3-2644c5560110 tempest-VolumesActionsTest-1466645267 tempest-VolumesActionsTest-1466645267-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:16:07.689435 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-5910b4d2-e6fc-4109-a2e3-2644c5560110 tempest-VolumesActionsTest-1466645267 tempest-VolumesActionsTest-1466645267-project] [instance: 78102129-cae3-4674-852a-798d0c8a732d] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:16:07.696471 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-5910b4d2-e6fc-4109-a2e3-2644c5560110 tempest-VolumesActionsTest-1466645267 tempest-VolumesActionsTest-1466645267-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:16:07.697087 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-5910b4d2-e6fc-4109-a2e3-2644c5560110 tempest-VolumesActionsTest-1466645267 tempest-VolumesActionsTest-1466645267-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:16:07.697893 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-5910b4d2-e6fc-4109-a2e3-2644c5560110 tempest-VolumesActionsTest-1466645267 tempest-VolumesActionsTest-1466645267-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:16:07.698334 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-5910b4d2-e6fc-4109-a2e3-2644c5560110 tempest-VolumesActionsTest-1466645267 tempest-VolumesActionsTest-1466645267-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:16:07.836968 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-5910b4d2-e6fc-4109-a2e3-2644c5560110 tempest-VolumesActionsTest-1466645267 tempest-VolumesActionsTest-1466645267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90fc6c2d12f3420eb7d646d7fceb8965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f7e5a8b43740ab8cd82b939a8af457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:16:07.844414 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-5910b4d2-e6fc-4109-a2e3-2644c5560110 tempest-VolumesActionsTest-1466645267 tempest-VolumesActionsTest-1466645267-project] 10.222.0.20 "GET /compute/v2.1/servers/78102129-cae3-4674-852a-798d0c8a732d" status: 200 len: 1313 microversion: 2.1 time: 0.159692 Jul 01 04:16:07.848583 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 492/973] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:16:07 2022] GET /compute/v2.1/servers/78102129-cae3-4674-852a-798d0c8a732d => generated 1313 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 04:16:08.862763 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-061da274-8ba5-4c48-89b1-25b532241ba7 tempest-VolumesActionsTest-1466645267 tempest-VolumesActionsTest-1466645267-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:16:08.863451 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-061da274-8ba5-4c48-89b1-25b532241ba7 tempest-VolumesActionsTest-1466645267 tempest-VolumesActionsTest-1466645267-project] [instance: 78102129-cae3-4674-852a-798d0c8a732d] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:16:08.870979 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-061da274-8ba5-4c48-89b1-25b532241ba7 tempest-VolumesActionsTest-1466645267 tempest-VolumesActionsTest-1466645267-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:16:08.871481 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-061da274-8ba5-4c48-89b1-25b532241ba7 tempest-VolumesActionsTest-1466645267 tempest-VolumesActionsTest-1466645267-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:16:08.872260 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-061da274-8ba5-4c48-89b1-25b532241ba7 tempest-VolumesActionsTest-1466645267 tempest-VolumesActionsTest-1466645267-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:16:08.872770 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-061da274-8ba5-4c48-89b1-25b532241ba7 tempest-VolumesActionsTest-1466645267 tempest-VolumesActionsTest-1466645267-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:16:09.011406 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-061da274-8ba5-4c48-89b1-25b532241ba7 tempest-VolumesActionsTest-1466645267 tempest-VolumesActionsTest-1466645267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90fc6c2d12f3420eb7d646d7fceb8965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f7e5a8b43740ab8cd82b939a8af457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:16:09.018087 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-061da274-8ba5-4c48-89b1-25b532241ba7 tempest-VolumesActionsTest-1466645267 tempest-VolumesActionsTest-1466645267-project] 10.222.0.20 "GET /compute/v2.1/servers/78102129-cae3-4674-852a-798d0c8a732d" status: 200 len: 1313 microversion: 2.1 time: 0.159400 Jul 01 04:16:09.018722 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 482/974] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:16:08 2022] GET /compute/v2.1/servers/78102129-cae3-4674-852a-798d0c8a732d => generated 1313 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:16:09.156938 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-a5cfc7b3-7029-42c9-8077-7fcdd93ff92e tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "001a65a8-5ce1-4664-b748-68fb7a74eee1"}} {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 04:16:09.157990 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-a5cfc7b3-7029-42c9-8077-7fcdd93ff92e tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] [instance: 20264c61-166b-4dce-9121-d530cedf677f] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:16:09.165038 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-a5cfc7b3-7029-42c9-8077-7fcdd93ff92e tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:16:09.165483 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-a5cfc7b3-7029-42c9-8077-7fcdd93ff92e tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:16:09.166242 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-a5cfc7b3-7029-42c9-8077-7fcdd93ff92e tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:16:09.166678 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-a5cfc7b3-7029-42c9-8077-7fcdd93ff92e tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:16:09.813249 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-a5cfc7b3-7029-42c9-8077-7fcdd93ff92e tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] 10.222.0.20 "POST /compute/v2.1/servers/20264c61-166b-4dce-9121-d530cedf677f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.659986 Jul 01 04:16:09.813894 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 493/975] 10.222.0.20 () {60 vars in 1322 bytes} [Fri Jul 1 04:16:09 2022] POST /compute/v2.1/servers/20264c61-166b-4dce-9121-d530cedf677f/os-volume_attachments => generated 194 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 04:16:10.036450 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-0813f97f-525e-4618-b62b-d7477e92cf60 tempest-VolumesActionsTest-1466645267 tempest-VolumesActionsTest-1466645267-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:16:10.037077 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-0813f97f-525e-4618-b62b-d7477e92cf60 tempest-VolumesActionsTest-1466645267 tempest-VolumesActionsTest-1466645267-project] [instance: 78102129-cae3-4674-852a-798d0c8a732d] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:16:10.043747 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-0813f97f-525e-4618-b62b-d7477e92cf60 tempest-VolumesActionsTest-1466645267 tempest-VolumesActionsTest-1466645267-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:16:10.044202 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-0813f97f-525e-4618-b62b-d7477e92cf60 tempest-VolumesActionsTest-1466645267 tempest-VolumesActionsTest-1466645267-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:16:10.044983 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-0813f97f-525e-4618-b62b-d7477e92cf60 tempest-VolumesActionsTest-1466645267 tempest-VolumesActionsTest-1466645267-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:16:10.045426 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-0813f97f-525e-4618-b62b-d7477e92cf60 tempest-VolumesActionsTest-1466645267 tempest-VolumesActionsTest-1466645267-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:16:10.174755 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-0813f97f-525e-4618-b62b-d7477e92cf60 tempest-VolumesActionsTest-1466645267 tempest-VolumesActionsTest-1466645267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90fc6c2d12f3420eb7d646d7fceb8965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f7e5a8b43740ab8cd82b939a8af457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:16:10.182869 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-0813f97f-525e-4618-b62b-d7477e92cf60 tempest-VolumesActionsTest-1466645267 tempest-VolumesActionsTest-1466645267-project] 10.222.0.20 "GET /compute/v2.1/servers/78102129-cae3-4674-852a-798d0c8a732d" status: 200 len: 1313 microversion: 2.1 time: 0.150692 Jul 01 04:16:10.183464 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 483/976] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:16:10 2022] GET /compute/v2.1/servers/78102129-cae3-4674-852a-798d0c8a732d => generated 1313 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:16:10.973133 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG dbcounter [-] [118712] Writing DB stats nova_cell0:SELECT=2 {{(pid=118712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:16:11.146901 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [req-e22056e0-d0f3-4490-a41e-80b803e706ff req-56be7f60-78bf-415d-80ed-38a4991935e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "78102129-cae3-4674-852a-798d0c8a732d", "name": "network-vif-plugged", "status": "completed", "tag": "f21cfe59-9373-43e9-91d6-68aaba681006"}]} {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 04:16:11.155661 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [req-e22056e0-d0f3-4490-a41e-80b803e706ff req-56be7f60-78bf-415d-80ed-38a4991935e3 service nova] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:16:11.156107 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [req-e22056e0-d0f3-4490-a41e-80b803e706ff req-56be7f60-78bf-415d-80ed-38a4991935e3 service nova] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:16:11.166766 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.compute.server_external_events [req-e22056e0-d0f3-4490-a41e-80b803e706ff req-56be7f60-78bf-415d-80ed-38a4991935e3 service nova] Creating event network-vif-plugged:f21cfe59-9373-43e9-91d6-68aaba681006 for instance 78102129-cae3-4674-852a-798d0c8a732d on hv-cinder-84684 Jul 01 04:16:11.171538 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [req-e22056e0-d0f3-4490-a41e-80b803e706ff req-56be7f60-78bf-415d-80ed-38a4991935e3 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.199730 Jul 01 04:16:11.172128 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 494/977] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Jul 1 04:16:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 04:16:11.200448 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-70000ec0-62c2-4b05-97dc-52757f17d506 tempest-VolumesActionsTest-1466645267 tempest-VolumesActionsTest-1466645267-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:16:11.201090 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-70000ec0-62c2-4b05-97dc-52757f17d506 tempest-VolumesActionsTest-1466645267 tempest-VolumesActionsTest-1466645267-project] [instance: 78102129-cae3-4674-852a-798d0c8a732d] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:16:11.202922 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG dbcounter [-] [118711] Writing DB stats nova_cell0:SELECT=2 {{(pid=118711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:16:11.203622 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG dbcounter [-] [118711] Writing DB stats nova_cell0:SELECT=6 {{(pid=118711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:16:11.208965 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-70000ec0-62c2-4b05-97dc-52757f17d506 tempest-VolumesActionsTest-1466645267 tempest-VolumesActionsTest-1466645267-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:16:11.209423 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-70000ec0-62c2-4b05-97dc-52757f17d506 tempest-VolumesActionsTest-1466645267 tempest-VolumesActionsTest-1466645267-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:16:11.210862 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-70000ec0-62c2-4b05-97dc-52757f17d506 tempest-VolumesActionsTest-1466645267 tempest-VolumesActionsTest-1466645267-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:16:11.211340 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-70000ec0-62c2-4b05-97dc-52757f17d506 tempest-VolumesActionsTest-1466645267 tempest-VolumesActionsTest-1466645267-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:16:11.348181 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-70000ec0-62c2-4b05-97dc-52757f17d506 tempest-VolumesActionsTest-1466645267 tempest-VolumesActionsTest-1466645267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90fc6c2d12f3420eb7d646d7fceb8965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f7e5a8b43740ab8cd82b939a8af457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:16:11.356316 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-70000ec0-62c2-4b05-97dc-52757f17d506 tempest-VolumesActionsTest-1466645267 tempest-VolumesActionsTest-1466645267-project] 10.222.0.20 "GET /compute/v2.1/servers/78102129-cae3-4674-852a-798d0c8a732d" status: 200 len: 1313 microversion: 2.1 time: 0.159747 Jul 01 04:16:11.356874 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 484/978] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:16:11 2022] GET /compute/v2.1/servers/78102129-cae3-4674-852a-798d0c8a732d => generated 1313 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:16:12.374588 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-9e0976c6-c5c7-4e82-9645-1e96f55a5093 tempest-VolumesActionsTest-1466645267 tempest-VolumesActionsTest-1466645267-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:16:12.375326 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-9e0976c6-c5c7-4e82-9645-1e96f55a5093 tempest-VolumesActionsTest-1466645267 tempest-VolumesActionsTest-1466645267-project] [instance: 78102129-cae3-4674-852a-798d0c8a732d] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:16:12.381538 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-9e0976c6-c5c7-4e82-9645-1e96f55a5093 tempest-VolumesActionsTest-1466645267 tempest-VolumesActionsTest-1466645267-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:16:12.381999 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-9e0976c6-c5c7-4e82-9645-1e96f55a5093 tempest-VolumesActionsTest-1466645267 tempest-VolumesActionsTest-1466645267-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:16:12.382769 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-9e0976c6-c5c7-4e82-9645-1e96f55a5093 tempest-VolumesActionsTest-1466645267 tempest-VolumesActionsTest-1466645267-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:16:12.383216 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-9e0976c6-c5c7-4e82-9645-1e96f55a5093 tempest-VolumesActionsTest-1466645267 tempest-VolumesActionsTest-1466645267-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:16:12.517943 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-9e0976c6-c5c7-4e82-9645-1e96f55a5093 tempest-VolumesActionsTest-1466645267 tempest-VolumesActionsTest-1466645267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90fc6c2d12f3420eb7d646d7fceb8965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f7e5a8b43740ab8cd82b939a8af457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:16:12.526307 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-9e0976c6-c5c7-4e82-9645-1e96f55a5093 tempest-VolumesActionsTest-1466645267 tempest-VolumesActionsTest-1466645267-project] 10.222.0.20 "GET /compute/v2.1/servers/78102129-cae3-4674-852a-798d0c8a732d" status: 200 len: 1313 microversion: 2.1 time: 0.156509 Jul 01 04:16:12.526895 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 495/979] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:16:12 2022] GET /compute/v2.1/servers/78102129-cae3-4674-852a-798d0c8a732d => generated 1313 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:16:13.543844 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-181b4ecd-4dcd-4779-991e-074b9599cf5d tempest-VolumesActionsTest-1466645267 tempest-VolumesActionsTest-1466645267-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:16:13.544464 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-181b4ecd-4dcd-4779-991e-074b9599cf5d tempest-VolumesActionsTest-1466645267 tempest-VolumesActionsTest-1466645267-project] [instance: 78102129-cae3-4674-852a-798d0c8a732d] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:16:13.551388 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-181b4ecd-4dcd-4779-991e-074b9599cf5d tempest-VolumesActionsTest-1466645267 tempest-VolumesActionsTest-1466645267-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:16:13.551847 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-181b4ecd-4dcd-4779-991e-074b9599cf5d tempest-VolumesActionsTest-1466645267 tempest-VolumesActionsTest-1466645267-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:16:13.552751 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-181b4ecd-4dcd-4779-991e-074b9599cf5d tempest-VolumesActionsTest-1466645267 tempest-VolumesActionsTest-1466645267-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:16:13.553835 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-181b4ecd-4dcd-4779-991e-074b9599cf5d tempest-VolumesActionsTest-1466645267 tempest-VolumesActionsTest-1466645267-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:16:13.680277 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-181b4ecd-4dcd-4779-991e-074b9599cf5d tempest-VolumesActionsTest-1466645267 tempest-VolumesActionsTest-1466645267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90fc6c2d12f3420eb7d646d7fceb8965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f7e5a8b43740ab8cd82b939a8af457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:16:13.687697 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-181b4ecd-4dcd-4779-991e-074b9599cf5d tempest-VolumesActionsTest-1466645267 tempest-VolumesActionsTest-1466645267-project] 10.222.0.20 "GET /compute/v2.1/servers/78102129-cae3-4674-852a-798d0c8a732d" status: 200 len: 1497 microversion: 2.1 time: 0.148431 Jul 01 04:16:13.688253 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 485/980] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:16:13 2022] GET /compute/v2.1/servers/78102129-cae3-4674-852a-798d0c8a732d => generated 1497 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:16:14.415760 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-fbe31711-c045-4e88-99f4-b730b99a6762 tempest-VolumesActionsTest-1466645267 tempest-VolumesActionsTest-1466645267-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:16:14.416300 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-fbe31711-c045-4e88-99f4-b730b99a6762 tempest-VolumesActionsTest-1466645267 tempest-VolumesActionsTest-1466645267-project] [instance: 78102129-cae3-4674-852a-798d0c8a732d] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:16:14.422678 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-fbe31711-c045-4e88-99f4-b730b99a6762 tempest-VolumesActionsTest-1466645267 tempest-VolumesActionsTest-1466645267-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:16:14.423142 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-fbe31711-c045-4e88-99f4-b730b99a6762 tempest-VolumesActionsTest-1466645267 tempest-VolumesActionsTest-1466645267-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:16:14.423943 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-fbe31711-c045-4e88-99f4-b730b99a6762 tempest-VolumesActionsTest-1466645267 tempest-VolumesActionsTest-1466645267-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:16:14.424382 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-fbe31711-c045-4e88-99f4-b730b99a6762 tempest-VolumesActionsTest-1466645267 tempest-VolumesActionsTest-1466645267-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:16:14.449412 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-fbe31711-c045-4e88-99f4-b730b99a6762 tempest-VolumesActionsTest-1466645267 tempest-VolumesActionsTest-1466645267-project] [instance: 78102129-cae3-4674-852a-798d0c8a732d] Going to try to terminate instance {{(pid=118712) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 01 04:16:14.746857 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-fbe31711-c045-4e88-99f4-b730b99a6762 tempest-VolumesActionsTest-1466645267 tempest-VolumesActionsTest-1466645267-project] 10.222.0.20 "DELETE /compute/v2.1/servers/78102129-cae3-4674-852a-798d0c8a732d" status: 204 len: 0 microversion: 2.1 time: 0.335253 Jul 01 04:16:14.747485 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 496/981] 10.222.0.20 () {58 vars in 1238 bytes} [Fri Jul 1 04:16:14 2022] DELETE /compute/v2.1/servers/78102129-cae3-4674-852a-798d0c8a732d => generated 0 bytes in 337 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 01 04:16:14.755612 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-563ec1b4-2341-46f9-bbd2-94a708348b7b tempest-VolumesActionsTest-1466645267 tempest-VolumesActionsTest-1466645267-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:16:14.756226 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-563ec1b4-2341-46f9-bbd2-94a708348b7b tempest-VolumesActionsTest-1466645267 tempest-VolumesActionsTest-1466645267-project] [instance: 78102129-cae3-4674-852a-798d0c8a732d] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:16:14.764071 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-563ec1b4-2341-46f9-bbd2-94a708348b7b tempest-VolumesActionsTest-1466645267 tempest-VolumesActionsTest-1466645267-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:16:14.764527 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-563ec1b4-2341-46f9-bbd2-94a708348b7b tempest-VolumesActionsTest-1466645267 tempest-VolumesActionsTest-1466645267-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:16:14.765299 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-563ec1b4-2341-46f9-bbd2-94a708348b7b tempest-VolumesActionsTest-1466645267 tempest-VolumesActionsTest-1466645267-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:16:14.765836 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-563ec1b4-2341-46f9-bbd2-94a708348b7b tempest-VolumesActionsTest-1466645267 tempest-VolumesActionsTest-1466645267-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:16:14.899410 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-563ec1b4-2341-46f9-bbd2-94a708348b7b tempest-VolumesActionsTest-1466645267 tempest-VolumesActionsTest-1466645267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90fc6c2d12f3420eb7d646d7fceb8965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f7e5a8b43740ab8cd82b939a8af457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:16:14.906978 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-563ec1b4-2341-46f9-bbd2-94a708348b7b tempest-VolumesActionsTest-1466645267 tempest-VolumesActionsTest-1466645267-project] 10.222.0.20 "GET /compute/v2.1/servers/78102129-cae3-4674-852a-798d0c8a732d" status: 200 len: 1503 microversion: 2.1 time: 0.155252 Jul 01 04:16:14.907571 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 486/982] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:16:14 2022] GET /compute/v2.1/servers/78102129-cae3-4674-852a-798d0c8a732d => generated 1503 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:16:15.924932 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-b9273c12-c126-4efc-a4c6-5ab24ccfe602 tempest-VolumesActionsTest-1466645267 tempest-VolumesActionsTest-1466645267-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:16:15.925573 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-b9273c12-c126-4efc-a4c6-5ab24ccfe602 tempest-VolumesActionsTest-1466645267 tempest-VolumesActionsTest-1466645267-project] [instance: 78102129-cae3-4674-852a-798d0c8a732d] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:16:15.932178 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-b9273c12-c126-4efc-a4c6-5ab24ccfe602 tempest-VolumesActionsTest-1466645267 tempest-VolumesActionsTest-1466645267-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:16:15.932502 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-b9273c12-c126-4efc-a4c6-5ab24ccfe602 tempest-VolumesActionsTest-1466645267 tempest-VolumesActionsTest-1466645267-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:16:15.933258 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-b9273c12-c126-4efc-a4c6-5ab24ccfe602 tempest-VolumesActionsTest-1466645267 tempest-VolumesActionsTest-1466645267-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:16:15.933695 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-b9273c12-c126-4efc-a4c6-5ab24ccfe602 tempest-VolumesActionsTest-1466645267 tempest-VolumesActionsTest-1466645267-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:16:16.064820 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-b9273c12-c126-4efc-a4c6-5ab24ccfe602 tempest-VolumesActionsTest-1466645267 tempest-VolumesActionsTest-1466645267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90fc6c2d12f3420eb7d646d7fceb8965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f7e5a8b43740ab8cd82b939a8af457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:16:16.072565 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-b9273c12-c126-4efc-a4c6-5ab24ccfe602 tempest-VolumesActionsTest-1466645267 tempest-VolumesActionsTest-1466645267-project] 10.222.0.20 "GET /compute/v2.1/servers/78102129-cae3-4674-852a-798d0c8a732d" status: 200 len: 1503 microversion: 2.1 time: 0.152046 Jul 01 04:16:16.073137 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 497/983] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:16:15 2022] GET /compute/v2.1/servers/78102129-cae3-4674-852a-798d0c8a732d => generated 1503 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:16:16.739848 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [req-b885ca8a-f9ac-4821-b807-69a00361870e req-2fd4ffc3-9e85-4555-87ef-c1d7089c18cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "78102129-cae3-4674-852a-798d0c8a732d", "name": "network-vif-deleted", "tag": "f21cfe59-9373-43e9-91d6-68aaba681006"}]} {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 04:16:16.747146 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [req-b885ca8a-f9ac-4821-b807-69a00361870e req-2fd4ffc3-9e85-4555-87ef-c1d7089c18cc service nova] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:16:16.747626 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [req-b885ca8a-f9ac-4821-b807-69a00361870e req-2fd4ffc3-9e85-4555-87ef-c1d7089c18cc service nova] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:16:16.759151 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.compute.server_external_events [req-b885ca8a-f9ac-4821-b807-69a00361870e req-2fd4ffc3-9e85-4555-87ef-c1d7089c18cc service nova] Creating event network-vif-deleted:f21cfe59-9373-43e9-91d6-68aaba681006 for instance 78102129-cae3-4674-852a-798d0c8a732d on hv-cinder-84684 Jul 01 04:16:16.764293 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [req-b885ca8a-f9ac-4821-b807-69a00361870e req-2fd4ffc3-9e85-4555-87ef-c1d7089c18cc service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030116 Jul 01 04:16:16.766297 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 487/984] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Jul 1 04:16:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 04:16:17.089748 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-6428b967-4598-441c-bd9e-ae3e00a87bd3 tempest-VolumesActionsTest-1466645267 tempest-VolumesActionsTest-1466645267-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:16:17.090365 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-6428b967-4598-441c-bd9e-ae3e00a87bd3 tempest-VolumesActionsTest-1466645267 tempest-VolumesActionsTest-1466645267-project] [instance: 78102129-cae3-4674-852a-798d0c8a732d] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:16:17.097020 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-6428b967-4598-441c-bd9e-ae3e00a87bd3 tempest-VolumesActionsTest-1466645267 tempest-VolumesActionsTest-1466645267-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:16:17.097684 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-6428b967-4598-441c-bd9e-ae3e00a87bd3 tempest-VolumesActionsTest-1466645267 tempest-VolumesActionsTest-1466645267-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:16:17.098451 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-6428b967-4598-441c-bd9e-ae3e00a87bd3 tempest-VolumesActionsTest-1466645267 tempest-VolumesActionsTest-1466645267-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:16:17.098901 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-6428b967-4598-441c-bd9e-ae3e00a87bd3 tempest-VolumesActionsTest-1466645267 tempest-VolumesActionsTest-1466645267-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:16:17.130648 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-6428b967-4598-441c-bd9e-ae3e00a87bd3 tempest-VolumesActionsTest-1466645267 tempest-VolumesActionsTest-1466645267-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:16:17.131104 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-6428b967-4598-441c-bd9e-ae3e00a87bd3 tempest-VolumesActionsTest-1466645267 tempest-VolumesActionsTest-1466645267-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:16:17.131609 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.objects.instance [None req-6428b967-4598-441c-bd9e-ae3e00a87bd3 tempest-VolumesActionsTest-1466645267 tempest-VolumesActionsTest-1466645267-project] Lazy-loading 'fault' on Instance uuid 78102129-cae3-4674-852a-798d0c8a732d {{(pid=118712) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 04:16:17.175582 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-6428b967-4598-441c-bd9e-ae3e00a87bd3 tempest-VolumesActionsTest-1466645267 tempest-VolumesActionsTest-1466645267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90fc6c2d12f3420eb7d646d7fceb8965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f7e5a8b43740ab8cd82b939a8af457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:16:17.183956 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-6428b967-4598-441c-bd9e-ae3e00a87bd3 tempest-VolumesActionsTest-1466645267 tempest-VolumesActionsTest-1466645267-project] 10.222.0.20 "GET /compute/v2.1/servers/78102129-cae3-4674-852a-798d0c8a732d" status: 200 len: 1303 microversion: 2.1 time: 0.098306 Jul 01 04:16:17.184671 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 498/985] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:16:17 2022] GET /compute/v2.1/servers/78102129-cae3-4674-852a-798d0c8a732d => generated 1303 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:16:17.299581 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-8c259984-4aa1-47a6-b9e3-6e82a8682aeb tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:16:17.300615 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-8c259984-4aa1-47a6-b9e3-6e82a8682aeb tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] [instance: 20264c61-166b-4dce-9121-d530cedf677f] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:16:17.306722 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-8c259984-4aa1-47a6-b9e3-6e82a8682aeb tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:16:17.307179 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-8c259984-4aa1-47a6-b9e3-6e82a8682aeb tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:16:17.307972 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-8c259984-4aa1-47a6-b9e3-6e82a8682aeb tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:16:17.308404 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-8c259984-4aa1-47a6-b9e3-6e82a8682aeb tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:16:17.338740 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-8c259984-4aa1-47a6-b9e3-6e82a8682aeb tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] 10.222.0.20 "GET /compute/v2.1/servers/20264c61-166b-4dce-9121-d530cedf677f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043692 Jul 01 04:16:17.339884 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 488/986] 10.222.0.20 () {58 vars in 1301 bytes} [Fri Jul 1 04:16:17 2022] GET /compute/v2.1/servers/20264c61-166b-4dce-9121-d530cedf677f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 04:16:17.349570 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-21a0897c-d7c7-400b-bd2d-a8cf02e425a1 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:16:17.350644 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-21a0897c-d7c7-400b-bd2d-a8cf02e425a1 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] [instance: 20264c61-166b-4dce-9121-d530cedf677f] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:16:17.356807 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-21a0897c-d7c7-400b-bd2d-a8cf02e425a1 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:16:17.357386 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-21a0897c-d7c7-400b-bd2d-a8cf02e425a1 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:16:17.358038 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-21a0897c-d7c7-400b-bd2d-a8cf02e425a1 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:16:17.358481 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-21a0897c-d7c7-400b-bd2d-a8cf02e425a1 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:16:17.388261 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-21a0897c-d7c7-400b-bd2d-a8cf02e425a1 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] 10.222.0.20 "GET /compute/v2.1/servers/20264c61-166b-4dce-9121-d530cedf677f/os-volume_attachments/001a65a8-5ce1-4664-b748-68fb7a74eee1" status: 200 len: 194 microversion: 2.1 time: 0.042566 Jul 01 04:16:17.392375 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 499/987] 10.222.0.20 () {58 vars in 1412 bytes} [Fri Jul 1 04:16:17 2022] GET /compute/v2.1/servers/20264c61-166b-4dce-9121-d530cedf677f/os-volume_attachments/001a65a8-5ce1-4664-b748-68fb7a74eee1 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 04:16:18.201298 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-ec2ee402-a248-44f1-8d8c-2f8bdfcaca92 tempest-VolumesActionsTest-1466645267 tempest-VolumesActionsTest-1466645267-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:16:18.201892 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-ec2ee402-a248-44f1-8d8c-2f8bdfcaca92 tempest-VolumesActionsTest-1466645267 tempest-VolumesActionsTest-1466645267-project] [instance: 78102129-cae3-4674-852a-798d0c8a732d] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:16:18.208157 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-ec2ee402-a248-44f1-8d8c-2f8bdfcaca92 tempest-VolumesActionsTest-1466645267 tempest-VolumesActionsTest-1466645267-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:16:18.208607 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-ec2ee402-a248-44f1-8d8c-2f8bdfcaca92 tempest-VolumesActionsTest-1466645267 tempest-VolumesActionsTest-1466645267-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:16:18.209368 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-ec2ee402-a248-44f1-8d8c-2f8bdfcaca92 tempest-VolumesActionsTest-1466645267 tempest-VolumesActionsTest-1466645267-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:16:18.209806 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-ec2ee402-a248-44f1-8d8c-2f8bdfcaca92 tempest-VolumesActionsTest-1466645267 tempest-VolumesActionsTest-1466645267-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:16:18.222842 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.wsgi [None req-ec2ee402-a248-44f1-8d8c-2f8bdfcaca92 tempest-VolumesActionsTest-1466645267 tempest-VolumesActionsTest-1466645267-project] HTTP exception thrown: Instance 78102129-cae3-4674-852a-798d0c8a732d could not be found. Jul 01 04:16:18.224507 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-ec2ee402-a248-44f1-8d8c-2f8bdfcaca92 tempest-VolumesActionsTest-1466645267 tempest-VolumesActionsTest-1466645267-project] Request method failure captured: Jul 01 04:16:18.224507 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: request: GET /compute/v2.1/servers/78102129-cae3-4674-852a-798d0c8a732d HTTP/1.1 Jul 01 04:16:18.224507 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: Accept: application/json Jul 01 04:16:18.224507 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: Accept-Encoding: identity Jul 01 04:16:18.224507 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: Connection: close Jul 01 04:16:18.224507 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: Content-Length: 0 Jul 01 04:16:18.224507 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: Content-Type: application/json Jul 01 04:16:18.224507 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: Host: 10.222.0.20 Jul 01 04:16:18.224507 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: Openstack-System-Scope: None Jul 01 04:16:18.224507 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: User-Agent: python-urllib3/1.26.9 Jul 01 04:16:18.224507 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-Auth-Token: gAAAAABivnT-9XbPuOIx67mkFfDXwhFsnvtQ0a9rw5MkHkAKd0hEO8ALMVnr7qrwMf8BMiIgmwyETkoJrQlFw35MPKK6rOoR5Tqav5jQeQOMvUriY95_eSk9k2esshZArPPU2QQEyBc6ukYtIw1bJYMWUufpXgVDzIaU8DYGv2O07D9FUcvm8bc Jul 01 04:16:18.224507 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-Domain-Id: None Jul 01 04:16:18.224507 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-Domain-Name: None Jul 01 04:16:18.224507 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-Identity-Status: Confirmed Jul 01 04:16:18.224507 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-Is-Admin-Project: True Jul 01 04:16:18.224507 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-Project-Domain-Id: default Jul 01 04:16:18.224507 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-Project-Domain-Name: Default Jul 01 04:16:18.224507 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-Project-Id: a9f7e5a8b43740ab8cd82b939a8af457 Jul 01 04:16:18.224507 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-Project-Name: tempest-VolumesActionsTest-1466645267 Jul 01 04:16:18.224507 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-Role: reader,member Jul 01 04:16:18.224507 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-Roles: reader,member Jul 01 04:16:18.226360 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/a9f7e5a8b43740ab8cd82b939a8af457"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_a9f7e5a8b43740ab8cd82b939a8af457", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a9f7e5a8b43740ab8cd82b939a8af457"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a9f7e5a8b43740ab8cd82b939a8af457"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}] Jul 01 04:16:18.226360 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-Tenant: tempest-VolumesActionsTest-1466645267 Jul 01 04:16:18.226360 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-Tenant-Id: a9f7e5a8b43740ab8cd82b939a8af457 Jul 01 04:16:18.226360 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-Tenant-Name: tempest-VolumesActionsTest-1466645267 Jul 01 04:16:18.226360 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-User: tempest-VolumesActionsTest-1466645267-project Jul 01 04:16:18.226360 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-User-Domain-Id: default Jul 01 04:16:18.226360 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-User-Domain-Name: Default Jul 01 04:16:18.226360 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-User-Id: 90fc6c2d12f3420eb7d646d7fceb8965 Jul 01 04:16:18.226360 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-User-Name: tempest-VolumesActionsTest-1466645267-project Jul 01 04:16:18.226360 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: method: > Jul 01 04:16:18.226360 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: exception: Instance 78102129-cae3-4674-852a-798d0c8a732d could not be found. Jul 01 04:16:18.226360 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: action_args: {'id': '78102129-cae3-4674-852a-798d0c8a732d'} Jul 01 04:16:18.227366 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 04:16:18.227366 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 04:16:18.227366 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 04:16:18.227366 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 04:16:18.227366 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 04:16:18.227366 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 04:16:18.227366 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 04:16:18.227366 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 04:16:18.227366 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 04:16:18.227366 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 04:16:18.227366 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 78102129-cae3-4674-852a-798d0c8a732d could not be found. Jul 01 04:16:18.227366 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi Jul 01 04:16:18.227366 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 04:16:18.227366 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi Jul 01 04:16:18.227366 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 04:16:18.227366 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 04:16:18.227366 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 04:16:18.227366 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 04:16:18.227366 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 04:16:18.227366 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 04:16:18.228994 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 04:16:18.228994 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 04:16:18.228994 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 04:16:18.228994 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 04:16:18.228994 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 04:16:18.228994 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 04:16:18.228994 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 04:16:18.228994 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 78102129-cae3-4674-852a-798d0c8a732d could not be found. Jul 01 04:16:18.228994 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi Jul 01 04:16:18.228994 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 04:16:18.228994 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi Jul 01 04:16:18.228994 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 04:16:18.228994 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 04:16:18.228994 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 04:16:18.228994 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 04:16:18.228994 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 04:16:18.228994 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 78102129-cae3-4674-852a-798d0c8a732d could not be found. Jul 01 04:16:18.228994 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi Jul 01 04:16:18.231255 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-ec2ee402-a248-44f1-8d8c-2f8bdfcaca92 tempest-VolumesActionsTest-1466645267 tempest-VolumesActionsTest-1466645267-project] Returning 404 to user: Instance 78102129-cae3-4674-852a-798d0c8a732d could not be found. {{(pid=118711) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 04:16:18.231255 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-ec2ee402-a248-44f1-8d8c-2f8bdfcaca92 tempest-VolumesActionsTest-1466645267 tempest-VolumesActionsTest-1466645267-project] 10.222.0.20 "GET /compute/v2.1/servers/78102129-cae3-4674-852a-798d0c8a732d" status: 404 len: 111 microversion: 2.1 time: 0.028622 Jul 01 04:16:18.231255 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 489/988] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:16:18 2022] GET /compute/v2.1/servers/78102129-cae3-4674-852a-798d0c8a732d => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 04:16:18.273987 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-95ab2888-799e-4fa0-9e0c-ebe3253c70e9 tempest-VolumesActionsTest-1466645267 tempest-VolumesActionsTest-1466645267-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-137190557", "imageRef": "66f9f4ba-339c-4967-8857-d65299a66629", "flavorRef": "452", "networks": [{"uuid": "fd264d76-83a6-4983-9c77-21f003ca1527"}]}} {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 04:16:18.327078 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.network.neutron [None req-95ab2888-799e-4fa0-9e0c-ebe3253c70e9 tempest-VolumesActionsTest-1466645267 tempest-VolumesActionsTest-1466645267-project] validate_networks() for [('fd264d76-83a6-4983-9c77-21f003ca1527', None, None, None, None, None)] {{(pid=118712) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 01 04:16:18.763281 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.virt.hardware [None req-95ab2888-799e-4fa0-9e0c-ebe3253c70e9 tempest-VolumesActionsTest-1466645267 tempest-VolumesActionsTest-1466645267-project] Flavor limits 0:0:0 {{(pid=118712) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 01 04:16:18.763717 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.virt.hardware [None req-95ab2888-799e-4fa0-9e0c-ebe3253c70e9 tempest-VolumesActionsTest-1466645267 tempest-VolumesActionsTest-1466645267-project] Image limits 0:0:0 {{(pid=118712) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 01 04:16:18.764197 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.virt.hardware [None req-95ab2888-799e-4fa0-9e0c-ebe3253c70e9 tempest-VolumesActionsTest-1466645267 tempest-VolumesActionsTest-1466645267-project] Flavor pref 0:0:0 {{(pid=118712) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 01 04:16:18.764608 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.virt.hardware [None req-95ab2888-799e-4fa0-9e0c-ebe3253c70e9 tempest-VolumesActionsTest-1466645267 tempest-VolumesActionsTest-1466645267-project] Image pref 0:0:0 {{(pid=118712) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 01 04:16:18.765022 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.virt.hardware [None req-95ab2888-799e-4fa0-9e0c-ebe3253c70e9 tempest-VolumesActionsTest-1466645267 tempest-VolumesActionsTest-1466645267-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118712) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 01 04:16:18.775033 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-95ab2888-799e-4fa0-9e0c-ebe3253c70e9 tempest-VolumesActionsTest-1466645267 tempest-VolumesActionsTest-1466645267-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:16:18.775505 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-95ab2888-799e-4fa0-9e0c-ebe3253c70e9 tempest-VolumesActionsTest-1466645267 tempest-VolumesActionsTest-1466645267-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:16:18.776304 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-95ab2888-799e-4fa0-9e0c-ebe3253c70e9 tempest-VolumesActionsTest-1466645267 tempest-VolumesActionsTest-1466645267-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:16:18.776739 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-95ab2888-799e-4fa0-9e0c-ebe3253c70e9 tempest-VolumesActionsTest-1466645267 tempest-VolumesActionsTest-1466645267-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:16:18.793881 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.quota [None req-95ab2888-799e-4fa0-9e0c-ebe3253c70e9 tempest-VolumesActionsTest-1466645267 tempest-VolumesActionsTest-1466645267-project] Getting quotas for project a9f7e5a8b43740ab8cd82b939a8af457. Resources: {'ram', 'cores', 'instances'} {{(pid=118712) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 04:16:18.797768 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.quota [None req-95ab2888-799e-4fa0-9e0c-ebe3253c70e9 tempest-VolumesActionsTest-1466645267 tempest-VolumesActionsTest-1466645267-project] Getting quotas for user 90fc6c2d12f3420eb7d646d7fceb8965 and project a9f7e5a8b43740ab8cd82b939a8af457. Resources: {'ram', 'cores', 'instances'} {{(pid=118712) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 04:16:18.808436 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-95ab2888-799e-4fa0-9e0c-ebe3253c70e9 tempest-VolumesActionsTest-1466645267 tempest-VolumesActionsTest-1466645267-project] Going to run 1 instances... {{(pid=118712) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 01 04:16:18.810708 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-95ab2888-799e-4fa0-9e0c-ebe3253c70e9 tempest-VolumesActionsTest-1466645267 tempest-VolumesActionsTest-1466645267-project] [instance: 421dc68a-3adc-4486-a2e2-5fb37376d936] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='66f9f4ba-339c-4967-8857-d65299a66629',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118712) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 01 04:16:18.968520 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-c11aff8e-5d27-456b-8cdb-1c915315cd69 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f375b568-8c91-4ce3-82a9-d72ae87c96c9"}} {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 04:16:18.969513 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-c11aff8e-5d27-456b-8cdb-1c915315cd69 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] [instance: 20264c61-166b-4dce-9121-d530cedf677f] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:16:18.976294 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-c11aff8e-5d27-456b-8cdb-1c915315cd69 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:16:18.976742 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-c11aff8e-5d27-456b-8cdb-1c915315cd69 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:16:18.977499 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-c11aff8e-5d27-456b-8cdb-1c915315cd69 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:16:18.977930 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-c11aff8e-5d27-456b-8cdb-1c915315cd69 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:16:18.983757 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-95ab2888-799e-4fa0-9e0c-ebe3253c70e9 tempest-VolumesActionsTest-1466645267 tempest-VolumesActionsTest-1466645267-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.713542 Jul 01 04:16:18.984586 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 500/989] 10.222.0.20 () {60 vars in 1146 bytes} [Fri Jul 1 04:16:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 715 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 01 04:16:18.995042 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-7bbe83cf-faaf-4504-88a2-413b86b535ce tempest-VolumesActionsTest-1466645267 tempest-VolumesActionsTest-1466645267-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:16:18.995649 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-7bbe83cf-faaf-4504-88a2-413b86b535ce tempest-VolumesActionsTest-1466645267 tempest-VolumesActionsTest-1466645267-project] [instance: 421dc68a-3adc-4486-a2e2-5fb37376d936] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:16:19.051216 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-7bbe83cf-faaf-4504-88a2-413b86b535ce tempest-VolumesActionsTest-1466645267 tempest-VolumesActionsTest-1466645267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90fc6c2d12f3420eb7d646d7fceb8965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f7e5a8b43740ab8cd82b939a8af457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:16:19.058226 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-7bbe83cf-faaf-4504-88a2-413b86b535ce tempest-VolumesActionsTest-1466645267 tempest-VolumesActionsTest-1466645267-project] 10.222.0.20 "GET /compute/v2.1/servers/421dc68a-3adc-4486-a2e2-5fb37376d936" status: 200 len: 1213 microversion: 2.1 time: 0.067843 Jul 01 04:16:19.058799 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 501/990] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:16:18 2022] GET /compute/v2.1/servers/421dc68a-3adc-4486-a2e2-5fb37376d936 => generated 1213 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 04:16:19.630597 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-c11aff8e-5d27-456b-8cdb-1c915315cd69 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] 10.222.0.20 "POST /compute/v2.1/servers/20264c61-166b-4dce-9121-d530cedf677f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.666128 Jul 01 04:16:19.631838 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 490/991] 10.222.0.20 () {60 vars in 1322 bytes} [Fri Jul 1 04:16:18 2022] POST /compute/v2.1/servers/20264c61-166b-4dce-9121-d530cedf677f/os-volume_attachments => generated 194 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 01 04:16:20.076058 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-69d1ac81-bf92-4d71-b0ab-4e602c48f92a tempest-VolumesActionsTest-1466645267 tempest-VolumesActionsTest-1466645267-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:16:20.076636 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-69d1ac81-bf92-4d71-b0ab-4e602c48f92a tempest-VolumesActionsTest-1466645267 tempest-VolumesActionsTest-1466645267-project] [instance: 421dc68a-3adc-4486-a2e2-5fb37376d936] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:16:20.084097 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-69d1ac81-bf92-4d71-b0ab-4e602c48f92a tempest-VolumesActionsTest-1466645267 tempest-VolumesActionsTest-1466645267-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:16:20.085206 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-69d1ac81-bf92-4d71-b0ab-4e602c48f92a tempest-VolumesActionsTest-1466645267 tempest-VolumesActionsTest-1466645267-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:16:20.085978 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-69d1ac81-bf92-4d71-b0ab-4e602c48f92a tempest-VolumesActionsTest-1466645267 tempest-VolumesActionsTest-1466645267-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:16:20.086419 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-69d1ac81-bf92-4d71-b0ab-4e602c48f92a tempest-VolumesActionsTest-1466645267 tempest-VolumesActionsTest-1466645267-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:16:20.148137 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-69d1ac81-bf92-4d71-b0ab-4e602c48f92a tempest-VolumesActionsTest-1466645267 tempest-VolumesActionsTest-1466645267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90fc6c2d12f3420eb7d646d7fceb8965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f7e5a8b43740ab8cd82b939a8af457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:16:20.156196 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-69d1ac81-bf92-4d71-b0ab-4e602c48f92a tempest-VolumesActionsTest-1466645267 tempest-VolumesActionsTest-1466645267-project] 10.222.0.20 "GET /compute/v2.1/servers/421dc68a-3adc-4486-a2e2-5fb37376d936" status: 200 len: 1217 microversion: 2.1 time: 0.084251 Jul 01 04:16:20.156756 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 502/992] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:16:20 2022] GET /compute/v2.1/servers/421dc68a-3adc-4486-a2e2-5fb37376d936 => generated 1217 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:16:21.174548 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-9f75e534-df49-401e-97f1-a3b54c88adc0 tempest-VolumesActionsTest-1466645267 tempest-VolumesActionsTest-1466645267-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:16:21.175256 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-9f75e534-df49-401e-97f1-a3b54c88adc0 tempest-VolumesActionsTest-1466645267 tempest-VolumesActionsTest-1466645267-project] [instance: 421dc68a-3adc-4486-a2e2-5fb37376d936] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:16:21.182027 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-9f75e534-df49-401e-97f1-a3b54c88adc0 tempest-VolumesActionsTest-1466645267 tempest-VolumesActionsTest-1466645267-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:16:21.182456 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-9f75e534-df49-401e-97f1-a3b54c88adc0 tempest-VolumesActionsTest-1466645267 tempest-VolumesActionsTest-1466645267-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:16:21.183245 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-9f75e534-df49-401e-97f1-a3b54c88adc0 tempest-VolumesActionsTest-1466645267 tempest-VolumesActionsTest-1466645267-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:16:21.183695 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-9f75e534-df49-401e-97f1-a3b54c88adc0 tempest-VolumesActionsTest-1466645267 tempest-VolumesActionsTest-1466645267-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:16:21.257338 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-9f75e534-df49-401e-97f1-a3b54c88adc0 tempest-VolumesActionsTest-1466645267 tempest-VolumesActionsTest-1466645267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90fc6c2d12f3420eb7d646d7fceb8965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f7e5a8b43740ab8cd82b939a8af457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:16:21.264346 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-9f75e534-df49-401e-97f1-a3b54c88adc0 tempest-VolumesActionsTest-1466645267 tempest-VolumesActionsTest-1466645267-project] 10.222.0.20 "GET /compute/v2.1/servers/421dc68a-3adc-4486-a2e2-5fb37376d936" status: 200 len: 1271 microversion: 2.1 time: 0.094418 Jul 01 04:16:21.264933 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 491/993] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:16:21 2022] GET /compute/v2.1/servers/421dc68a-3adc-4486-a2e2-5fb37376d936 => generated 1271 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:16:22.281795 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-52d862d4-8c57-4297-b5be-cb3ba1dbf415 tempest-VolumesActionsTest-1466645267 tempest-VolumesActionsTest-1466645267-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:16:22.282534 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-52d862d4-8c57-4297-b5be-cb3ba1dbf415 tempest-VolumesActionsTest-1466645267 tempest-VolumesActionsTest-1466645267-project] [instance: 421dc68a-3adc-4486-a2e2-5fb37376d936] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:16:22.293591 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-52d862d4-8c57-4297-b5be-cb3ba1dbf415 tempest-VolumesActionsTest-1466645267 tempest-VolumesActionsTest-1466645267-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:16:22.293960 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-52d862d4-8c57-4297-b5be-cb3ba1dbf415 tempest-VolumesActionsTest-1466645267 tempest-VolumesActionsTest-1466645267-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:16:22.294767 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-52d862d4-8c57-4297-b5be-cb3ba1dbf415 tempest-VolumesActionsTest-1466645267 tempest-VolumesActionsTest-1466645267-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:16:22.295208 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-52d862d4-8c57-4297-b5be-cb3ba1dbf415 tempest-VolumesActionsTest-1466645267 tempest-VolumesActionsTest-1466645267-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:16:22.450051 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [req-d5f5ee7d-e5af-487f-9315-24b4efc94c02 req-b5db189b-1c52-463d-8c47-dce8254fb134 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "421dc68a-3adc-4486-a2e2-5fb37376d936", "tag": "0bd4bfdd-e8ba-44e9-a80f-00513ead81dc"}]} {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 04:16:22.454832 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-52d862d4-8c57-4297-b5be-cb3ba1dbf415 tempest-VolumesActionsTest-1466645267 tempest-VolumesActionsTest-1466645267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90fc6c2d12f3420eb7d646d7fceb8965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f7e5a8b43740ab8cd82b939a8af457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:16:22.470249 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [req-d5f5ee7d-e5af-487f-9315-24b4efc94c02 req-b5db189b-1c52-463d-8c47-dce8254fb134 service nova] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:16:22.477184 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [req-d5f5ee7d-e5af-487f-9315-24b4efc94c02 req-b5db189b-1c52-463d-8c47-dce8254fb134 service nova] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:16:22.477326 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-52d862d4-8c57-4297-b5be-cb3ba1dbf415 tempest-VolumesActionsTest-1466645267 tempest-VolumesActionsTest-1466645267-project] 10.222.0.20 "GET /compute/v2.1/servers/421dc68a-3adc-4486-a2e2-5fb37376d936" status: 200 len: 1313 microversion: 2.1 time: 0.194380 Jul 01 04:16:22.477326 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 503/994] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:16:22 2022] GET /compute/v2.1/servers/421dc68a-3adc-4486-a2e2-5fb37376d936 => generated 1313 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:16:22.492006 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.compute.server_external_events [req-d5f5ee7d-e5af-487f-9315-24b4efc94c02 req-b5db189b-1c52-463d-8c47-dce8254fb134 service nova] Creating event network-changed:0bd4bfdd-e8ba-44e9-a80f-00513ead81dc for instance 421dc68a-3adc-4486-a2e2-5fb37376d936 on hv-cinder-84684 Jul 01 04:16:22.496707 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [req-d5f5ee7d-e5af-487f-9315-24b4efc94c02 req-b5db189b-1c52-463d-8c47-dce8254fb134 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057665 Jul 01 04:16:22.497298 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 492/995] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Jul 1 04:16:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 04:16:23.497473 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-a26ba201-f432-4b62-bec9-0e63c694d188 tempest-VolumesActionsTest-1466645267 tempest-VolumesActionsTest-1466645267-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:16:23.498032 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-a26ba201-f432-4b62-bec9-0e63c694d188 tempest-VolumesActionsTest-1466645267 tempest-VolumesActionsTest-1466645267-project] [instance: 421dc68a-3adc-4486-a2e2-5fb37376d936] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:16:23.504583 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-a26ba201-f432-4b62-bec9-0e63c694d188 tempest-VolumesActionsTest-1466645267 tempest-VolumesActionsTest-1466645267-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:16:23.505040 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-a26ba201-f432-4b62-bec9-0e63c694d188 tempest-VolumesActionsTest-1466645267 tempest-VolumesActionsTest-1466645267-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:16:23.505813 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-a26ba201-f432-4b62-bec9-0e63c694d188 tempest-VolumesActionsTest-1466645267 tempest-VolumesActionsTest-1466645267-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:16:23.506262 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-a26ba201-f432-4b62-bec9-0e63c694d188 tempest-VolumesActionsTest-1466645267 tempest-VolumesActionsTest-1466645267-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:16:23.635852 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-a26ba201-f432-4b62-bec9-0e63c694d188 tempest-VolumesActionsTest-1466645267 tempest-VolumesActionsTest-1466645267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90fc6c2d12f3420eb7d646d7fceb8965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f7e5a8b43740ab8cd82b939a8af457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:16:23.643439 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-a26ba201-f432-4b62-bec9-0e63c694d188 tempest-VolumesActionsTest-1466645267 tempest-VolumesActionsTest-1466645267-project] 10.222.0.20 "GET /compute/v2.1/servers/421dc68a-3adc-4486-a2e2-5fb37376d936" status: 200 len: 1313 microversion: 2.1 time: 0.149970 Jul 01 04:16:23.644014 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 504/996] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:16:23 2022] GET /compute/v2.1/servers/421dc68a-3adc-4486-a2e2-5fb37376d936 => generated 1313 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:16:24.661176 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-ecf34350-2da1-47ef-b643-53e9f3f1017d tempest-VolumesActionsTest-1466645267 tempest-VolumesActionsTest-1466645267-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:16:24.661866 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-ecf34350-2da1-47ef-b643-53e9f3f1017d tempest-VolumesActionsTest-1466645267 tempest-VolumesActionsTest-1466645267-project] [instance: 421dc68a-3adc-4486-a2e2-5fb37376d936] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:16:24.668322 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-ecf34350-2da1-47ef-b643-53e9f3f1017d tempest-VolumesActionsTest-1466645267 tempest-VolumesActionsTest-1466645267-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:16:24.668778 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-ecf34350-2da1-47ef-b643-53e9f3f1017d tempest-VolumesActionsTest-1466645267 tempest-VolumesActionsTest-1466645267-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:16:24.669585 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-ecf34350-2da1-47ef-b643-53e9f3f1017d tempest-VolumesActionsTest-1466645267 tempest-VolumesActionsTest-1466645267-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:16:24.670025 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-ecf34350-2da1-47ef-b643-53e9f3f1017d tempest-VolumesActionsTest-1466645267 tempest-VolumesActionsTest-1466645267-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:16:24.797792 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-ecf34350-2da1-47ef-b643-53e9f3f1017d tempest-VolumesActionsTest-1466645267 tempest-VolumesActionsTest-1466645267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90fc6c2d12f3420eb7d646d7fceb8965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f7e5a8b43740ab8cd82b939a8af457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:16:24.806163 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-ecf34350-2da1-47ef-b643-53e9f3f1017d tempest-VolumesActionsTest-1466645267 tempest-VolumesActionsTest-1466645267-project] 10.222.0.20 "GET /compute/v2.1/servers/421dc68a-3adc-4486-a2e2-5fb37376d936" status: 200 len: 1313 microversion: 2.1 time: 0.149638 Jul 01 04:16:24.806726 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 493/997] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:16:24 2022] GET /compute/v2.1/servers/421dc68a-3adc-4486-a2e2-5fb37376d936 => generated 1313 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:16:25.823690 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-7f3c7459-7f8e-4ad9-b919-e47331ac9055 tempest-VolumesActionsTest-1466645267 tempest-VolumesActionsTest-1466645267-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:16:25.824332 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-7f3c7459-7f8e-4ad9-b919-e47331ac9055 tempest-VolumesActionsTest-1466645267 tempest-VolumesActionsTest-1466645267-project] [instance: 421dc68a-3adc-4486-a2e2-5fb37376d936] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:16:25.830777 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-7f3c7459-7f8e-4ad9-b919-e47331ac9055 tempest-VolumesActionsTest-1466645267 tempest-VolumesActionsTest-1466645267-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:16:25.831265 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-7f3c7459-7f8e-4ad9-b919-e47331ac9055 tempest-VolumesActionsTest-1466645267 tempest-VolumesActionsTest-1466645267-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:16:25.832010 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-7f3c7459-7f8e-4ad9-b919-e47331ac9055 tempest-VolumesActionsTest-1466645267 tempest-VolumesActionsTest-1466645267-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:16:25.832445 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-7f3c7459-7f8e-4ad9-b919-e47331ac9055 tempest-VolumesActionsTest-1466645267 tempest-VolumesActionsTest-1466645267-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:16:25.837108 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG dbcounter [-] [118712] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=118712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:16:25.966721 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-7f3c7459-7f8e-4ad9-b919-e47331ac9055 tempest-VolumesActionsTest-1466645267 tempest-VolumesActionsTest-1466645267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90fc6c2d12f3420eb7d646d7fceb8965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f7e5a8b43740ab8cd82b939a8af457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:16:25.974382 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-7f3c7459-7f8e-4ad9-b919-e47331ac9055 tempest-VolumesActionsTest-1466645267 tempest-VolumesActionsTest-1466645267-project] 10.222.0.20 "GET /compute/v2.1/servers/421dc68a-3adc-4486-a2e2-5fb37376d936" status: 200 len: 1313 microversion: 2.1 time: 0.154522 Jul 01 04:16:25.974951 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 505/998] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:16:25 2022] GET /compute/v2.1/servers/421dc68a-3adc-4486-a2e2-5fb37376d936 => generated 1313 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:16:26.992322 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-675c607f-235a-4b1b-946e-4c71ec1f41e8 tempest-VolumesActionsTest-1466645267 tempest-VolumesActionsTest-1466645267-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:16:26.992972 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-675c607f-235a-4b1b-946e-4c71ec1f41e8 tempest-VolumesActionsTest-1466645267 tempest-VolumesActionsTest-1466645267-project] [instance: 421dc68a-3adc-4486-a2e2-5fb37376d936] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:16:26.999824 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-675c607f-235a-4b1b-946e-4c71ec1f41e8 tempest-VolumesActionsTest-1466645267 tempest-VolumesActionsTest-1466645267-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:16:27.000275 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-675c607f-235a-4b1b-946e-4c71ec1f41e8 tempest-VolumesActionsTest-1466645267 tempest-VolumesActionsTest-1466645267-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:16:27.001047 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-675c607f-235a-4b1b-946e-4c71ec1f41e8 tempest-VolumesActionsTest-1466645267 tempest-VolumesActionsTest-1466645267-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:16:27.001484 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-675c607f-235a-4b1b-946e-4c71ec1f41e8 tempest-VolumesActionsTest-1466645267 tempest-VolumesActionsTest-1466645267-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:16:27.151373 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-675c607f-235a-4b1b-946e-4c71ec1f41e8 tempest-VolumesActionsTest-1466645267 tempest-VolumesActionsTest-1466645267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90fc6c2d12f3420eb7d646d7fceb8965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f7e5a8b43740ab8cd82b939a8af457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:16:27.156394 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-675c607f-235a-4b1b-946e-4c71ec1f41e8 tempest-VolumesActionsTest-1466645267 tempest-VolumesActionsTest-1466645267-project] 10.222.0.20 "GET /compute/v2.1/servers/421dc68a-3adc-4486-a2e2-5fb37376d936" status: 200 len: 1313 microversion: 2.1 time: 0.168008 Jul 01 04:16:27.156784 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 494/999] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:16:26 2022] GET /compute/v2.1/servers/421dc68a-3adc-4486-a2e2-5fb37376d936 => generated 1313 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:16:27.168282 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [req-b21b0ab9-9d27-4809-87b7-b52f6fca3680 req-c64493a9-3900-4f70-ab33-44b7d6327ec9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "421dc68a-3adc-4486-a2e2-5fb37376d936", "name": "network-vif-plugged", "status": "completed", "tag": "0bd4bfdd-e8ba-44e9-a80f-00513ead81dc"}]} {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 04:16:27.168841 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-272d6657-8834-41c8-b0ca-44f8711f8792 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:16:27.169660 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-272d6657-8834-41c8-b0ca-44f8711f8792 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] [instance: 20264c61-166b-4dce-9121-d530cedf677f] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:16:27.176074 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-272d6657-8834-41c8-b0ca-44f8711f8792 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:16:27.176526 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-272d6657-8834-41c8-b0ca-44f8711f8792 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:16:27.177296 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-272d6657-8834-41c8-b0ca-44f8711f8792 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:16:27.177741 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-272d6657-8834-41c8-b0ca-44f8711f8792 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:16:27.177856 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [req-b21b0ab9-9d27-4809-87b7-b52f6fca3680 req-c64493a9-3900-4f70-ab33-44b7d6327ec9 service nova] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:16:27.178346 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [req-b21b0ab9-9d27-4809-87b7-b52f6fca3680 req-c64493a9-3900-4f70-ab33-44b7d6327ec9 service nova] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:16:27.182144 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG dbcounter [-] [118711] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:16:27.190100 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.compute.server_external_events [req-b21b0ab9-9d27-4809-87b7-b52f6fca3680 req-c64493a9-3900-4f70-ab33-44b7d6327ec9 service nova] Creating event network-vif-plugged:0bd4bfdd-e8ba-44e9-a80f-00513ead81dc for instance 421dc68a-3adc-4486-a2e2-5fb37376d936 on hv-cinder-84684 Jul 01 04:16:27.196022 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [req-b21b0ab9-9d27-4809-87b7-b52f6fca3680 req-c64493a9-3900-4f70-ab33-44b7d6327ec9 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031006 Jul 01 04:16:27.196625 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 506/1000] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Jul 1 04:16:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 04:16:27.209593 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-272d6657-8834-41c8-b0ca-44f8711f8792 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] 10.222.0.20 "GET /compute/v2.1/servers/20264c61-166b-4dce-9121-d530cedf677f/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045254 Jul 01 04:16:27.213255 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 495/1001] 10.222.0.20 () {58 vars in 1301 bytes} [Fri Jul 1 04:16:27 2022] GET /compute/v2.1/servers/20264c61-166b-4dce-9121-d530cedf677f/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 01 04:16:27.353889 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-498fa51e-2805-48c0-b60c-aed801282723 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:16:27.354480 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-498fa51e-2805-48c0-b60c-aed801282723 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] [instance: 20264c61-166b-4dce-9121-d530cedf677f] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:16:27.360976 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-498fa51e-2805-48c0-b60c-aed801282723 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:16:27.361436 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-498fa51e-2805-48c0-b60c-aed801282723 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:16:27.362214 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-498fa51e-2805-48c0-b60c-aed801282723 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:16:27.362685 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-498fa51e-2805-48c0-b60c-aed801282723 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:16:27.392111 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-498fa51e-2805-48c0-b60c-aed801282723 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] 10.222.0.20 "GET /compute/v2.1/servers/20264c61-166b-4dce-9121-d530cedf677f/os-volume_attachments/001a65a8-5ce1-4664-b748-68fb7a74eee1" status: 200 len: 194 microversion: 2.1 time: 0.043033 Jul 01 04:16:27.392687 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 507/1002] 10.222.0.20 () {58 vars in 1412 bytes} [Fri Jul 1 04:16:27 2022] GET /compute/v2.1/servers/20264c61-166b-4dce-9121-d530cedf677f/os-volume_attachments/001a65a8-5ce1-4664-b748-68fb7a74eee1 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 04:16:27.402576 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-25458adb-73f6-4adb-abac-426e64de4468 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:16:27.403118 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-25458adb-73f6-4adb-abac-426e64de4468 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] [instance: 20264c61-166b-4dce-9121-d530cedf677f] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:16:27.409868 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-25458adb-73f6-4adb-abac-426e64de4468 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:16:27.410326 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-25458adb-73f6-4adb-abac-426e64de4468 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:16:27.411095 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-25458adb-73f6-4adb-abac-426e64de4468 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:16:27.411586 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-25458adb-73f6-4adb-abac-426e64de4468 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:16:27.495892 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.objects.instance [None req-25458adb-73f6-4adb-abac-426e64de4468 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lazy-loading 'services' on Instance uuid 20264c61-166b-4dce-9121-d530cedf677f {{(pid=118711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 04:16:27.763044 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-25458adb-73f6-4adb-abac-426e64de4468 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] 10.222.0.20 "DELETE /compute/v2.1/servers/20264c61-166b-4dce-9121-d530cedf677f/os-volume_attachments/001a65a8-5ce1-4664-b748-68fb7a74eee1" status: 202 len: 0 microversion: 2.1 time: 0.364367 Jul 01 04:16:27.763670 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 496/1003] 10.222.0.20 () {58 vars in 1415 bytes} [Fri Jul 1 04:16:27 2022] DELETE /compute/v2.1/servers/20264c61-166b-4dce-9121-d530cedf677f/os-volume_attachments/001a65a8-5ce1-4664-b748-68fb7a74eee1 => generated 0 bytes in 366 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 04:16:28.173311 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-24d972b6-ef48-43a0-99bf-38729e67218a tempest-VolumesActionsTest-1466645267 tempest-VolumesActionsTest-1466645267-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:16:28.173873 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-24d972b6-ef48-43a0-99bf-38729e67218a tempest-VolumesActionsTest-1466645267 tempest-VolumesActionsTest-1466645267-project] [instance: 421dc68a-3adc-4486-a2e2-5fb37376d936] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:16:28.180321 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-24d972b6-ef48-43a0-99bf-38729e67218a tempest-VolumesActionsTest-1466645267 tempest-VolumesActionsTest-1466645267-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:16:28.180783 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-24d972b6-ef48-43a0-99bf-38729e67218a tempest-VolumesActionsTest-1466645267 tempest-VolumesActionsTest-1466645267-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:16:28.181557 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-24d972b6-ef48-43a0-99bf-38729e67218a tempest-VolumesActionsTest-1466645267 tempest-VolumesActionsTest-1466645267-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:16:28.182003 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-24d972b6-ef48-43a0-99bf-38729e67218a tempest-VolumesActionsTest-1466645267 tempest-VolumesActionsTest-1466645267-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:16:28.315608 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-24d972b6-ef48-43a0-99bf-38729e67218a tempest-VolumesActionsTest-1466645267 tempest-VolumesActionsTest-1466645267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90fc6c2d12f3420eb7d646d7fceb8965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f7e5a8b43740ab8cd82b939a8af457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:16:28.323757 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-24d972b6-ef48-43a0-99bf-38729e67218a tempest-VolumesActionsTest-1466645267 tempest-VolumesActionsTest-1466645267-project] 10.222.0.20 "GET /compute/v2.1/servers/421dc68a-3adc-4486-a2e2-5fb37376d936" status: 200 len: 1313 microversion: 2.1 time: 0.154449 Jul 01 04:16:28.324318 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 508/1004] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:16:28 2022] GET /compute/v2.1/servers/421dc68a-3adc-4486-a2e2-5fb37376d936 => generated 1313 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:16:29.342116 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-620810e0-75d4-48cb-9def-a33fe403d4be tempest-VolumesActionsTest-1466645267 tempest-VolumesActionsTest-1466645267-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:16:29.342816 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-620810e0-75d4-48cb-9def-a33fe403d4be tempest-VolumesActionsTest-1466645267 tempest-VolumesActionsTest-1466645267-project] [instance: 421dc68a-3adc-4486-a2e2-5fb37376d936] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:16:29.349600 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-620810e0-75d4-48cb-9def-a33fe403d4be tempest-VolumesActionsTest-1466645267 tempest-VolumesActionsTest-1466645267-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:16:29.350059 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-620810e0-75d4-48cb-9def-a33fe403d4be tempest-VolumesActionsTest-1466645267 tempest-VolumesActionsTest-1466645267-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:16:29.350844 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-620810e0-75d4-48cb-9def-a33fe403d4be tempest-VolumesActionsTest-1466645267 tempest-VolumesActionsTest-1466645267-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:16:29.351306 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-620810e0-75d4-48cb-9def-a33fe403d4be tempest-VolumesActionsTest-1466645267 tempest-VolumesActionsTest-1466645267-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:16:29.496399 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-620810e0-75d4-48cb-9def-a33fe403d4be tempest-VolumesActionsTest-1466645267 tempest-VolumesActionsTest-1466645267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90fc6c2d12f3420eb7d646d7fceb8965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f7e5a8b43740ab8cd82b939a8af457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:16:29.504147 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-620810e0-75d4-48cb-9def-a33fe403d4be tempest-VolumesActionsTest-1466645267 tempest-VolumesActionsTest-1466645267-project] 10.222.0.20 "GET /compute/v2.1/servers/421dc68a-3adc-4486-a2e2-5fb37376d936" status: 200 len: 1498 microversion: 2.1 time: 0.166927 Jul 01 04:16:29.504714 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 497/1005] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:16:29 2022] GET /compute/v2.1/servers/421dc68a-3adc-4486-a2e2-5fb37376d936 => generated 1498 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:16:29.941739 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG dbcounter [-] [118712] Writing DB stats nova_cell0:SELECT=2 {{(pid=118712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:16:29.943084 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG dbcounter [-] [118712] Writing DB stats nova_cell0:SELECT=8 {{(pid=118712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:16:29.947800 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-8f884e90-9d29-494b-971a-f57e194f3656 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:16:29.948514 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-8f884e90-9d29-494b-971a-f57e194f3656 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] [instance: 20264c61-166b-4dce-9121-d530cedf677f] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:16:29.954517 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-8f884e90-9d29-494b-971a-f57e194f3656 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:16:29.955060 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-8f884e90-9d29-494b-971a-f57e194f3656 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:16:29.955937 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-8f884e90-9d29-494b-971a-f57e194f3656 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:16:29.956505 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-8f884e90-9d29-494b-971a-f57e194f3656 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:16:29.986947 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-8f884e90-9d29-494b-971a-f57e194f3656 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] 10.222.0.20 "GET /compute/v2.1/servers/20264c61-166b-4dce-9121-d530cedf677f/os-volume_attachments/f375b568-8c91-4ce3-82a9-d72ae87c96c9" status: 200 len: 194 microversion: 2.1 time: 0.046201 Jul 01 04:16:29.987561 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 509/1006] 10.222.0.20 () {58 vars in 1412 bytes} [Fri Jul 1 04:16:29 2022] GET /compute/v2.1/servers/20264c61-166b-4dce-9121-d530cedf677f/os-volume_attachments/f375b568-8c91-4ce3-82a9-d72ae87c96c9 => generated 194 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 04:16:29.998769 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-f951dc4b-6cb1-456d-adaa-d4c34130d4e6 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:16:29.998769 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-f951dc4b-6cb1-456d-adaa-d4c34130d4e6 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] [instance: 20264c61-166b-4dce-9121-d530cedf677f] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:16:30.004244 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-f951dc4b-6cb1-456d-adaa-d4c34130d4e6 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:16:30.004693 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-f951dc4b-6cb1-456d-adaa-d4c34130d4e6 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:16:30.005459 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-f951dc4b-6cb1-456d-adaa-d4c34130d4e6 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:16:30.005899 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-f951dc4b-6cb1-456d-adaa-d4c34130d4e6 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:16:30.086328 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.objects.instance [None req-f951dc4b-6cb1-456d-adaa-d4c34130d4e6 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lazy-loading 'services' on Instance uuid 20264c61-166b-4dce-9121-d530cedf677f {{(pid=118711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 04:16:30.265982 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-1e85c437-dfb5-487c-8fc4-72ab6ce894b3 tempest-VolumesActionsTest-1466645267 tempest-VolumesActionsTest-1466645267-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:16:30.266477 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-1e85c437-dfb5-487c-8fc4-72ab6ce894b3 tempest-VolumesActionsTest-1466645267 tempest-VolumesActionsTest-1466645267-project] [instance: 421dc68a-3adc-4486-a2e2-5fb37376d936] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:16:30.273176 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-1e85c437-dfb5-487c-8fc4-72ab6ce894b3 tempest-VolumesActionsTest-1466645267 tempest-VolumesActionsTest-1466645267-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:16:30.274120 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-1e85c437-dfb5-487c-8fc4-72ab6ce894b3 tempest-VolumesActionsTest-1466645267 tempest-VolumesActionsTest-1466645267-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:16:30.274880 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-1e85c437-dfb5-487c-8fc4-72ab6ce894b3 tempest-VolumesActionsTest-1466645267 tempest-VolumesActionsTest-1466645267-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:16:30.275389 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-1e85c437-dfb5-487c-8fc4-72ab6ce894b3 tempest-VolumesActionsTest-1466645267 tempest-VolumesActionsTest-1466645267-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:16:30.288681 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-f951dc4b-6cb1-456d-adaa-d4c34130d4e6 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] 10.222.0.20 "DELETE /compute/v2.1/servers/20264c61-166b-4dce-9121-d530cedf677f/os-volume_attachments/f375b568-8c91-4ce3-82a9-d72ae87c96c9" status: 202 len: 0 microversion: 2.1 time: 0.294546 Jul 01 04:16:30.289968 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 498/1007] 10.222.0.20 () {58 vars in 1415 bytes} [Fri Jul 1 04:16:29 2022] DELETE /compute/v2.1/servers/20264c61-166b-4dce-9121-d530cedf677f/os-volume_attachments/f375b568-8c91-4ce3-82a9-d72ae87c96c9 => generated 0 bytes in 297 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 04:16:30.305542 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-1e85c437-dfb5-487c-8fc4-72ab6ce894b3 tempest-VolumesActionsTest-1466645267 tempest-VolumesActionsTest-1466645267-project] [instance: 421dc68a-3adc-4486-a2e2-5fb37376d936] Going to try to terminate instance {{(pid=118712) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 01 04:16:30.586966 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-1e85c437-dfb5-487c-8fc4-72ab6ce894b3 tempest-VolumesActionsTest-1466645267 tempest-VolumesActionsTest-1466645267-project] 10.222.0.20 "DELETE /compute/v2.1/servers/421dc68a-3adc-4486-a2e2-5fb37376d936" status: 204 len: 0 microversion: 2.1 time: 0.324125 Jul 01 04:16:30.587763 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 510/1008] 10.222.0.20 () {58 vars in 1238 bytes} [Fri Jul 1 04:16:30 2022] DELETE /compute/v2.1/servers/421dc68a-3adc-4486-a2e2-5fb37376d936 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 01 04:16:30.596928 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-1ef5caaf-4651-4bbe-930c-83670eb369b1 tempest-VolumesActionsTest-1466645267 tempest-VolumesActionsTest-1466645267-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:16:30.597635 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-1ef5caaf-4651-4bbe-930c-83670eb369b1 tempest-VolumesActionsTest-1466645267 tempest-VolumesActionsTest-1466645267-project] [instance: 421dc68a-3adc-4486-a2e2-5fb37376d936] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:16:30.599569 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG dbcounter [-] [118711] Writing DB stats nova_api:SELECT=56,nova_api:INSERT=3 {{(pid=118711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:16:30.604558 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-1ef5caaf-4651-4bbe-930c-83670eb369b1 tempest-VolumesActionsTest-1466645267 tempest-VolumesActionsTest-1466645267-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:16:30.605013 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-1ef5caaf-4651-4bbe-930c-83670eb369b1 tempest-VolumesActionsTest-1466645267 tempest-VolumesActionsTest-1466645267-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:16:30.605776 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-1ef5caaf-4651-4bbe-930c-83670eb369b1 tempest-VolumesActionsTest-1466645267 tempest-VolumesActionsTest-1466645267-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:16:30.606217 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-1ef5caaf-4651-4bbe-930c-83670eb369b1 tempest-VolumesActionsTest-1466645267 tempest-VolumesActionsTest-1466645267-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:16:30.738641 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-1ef5caaf-4651-4bbe-930c-83670eb369b1 tempest-VolumesActionsTest-1466645267 tempest-VolumesActionsTest-1466645267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90fc6c2d12f3420eb7d646d7fceb8965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f7e5a8b43740ab8cd82b939a8af457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:16:30.750919 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-1ef5caaf-4651-4bbe-930c-83670eb369b1 tempest-VolumesActionsTest-1466645267 tempest-VolumesActionsTest-1466645267-project] 10.222.0.20 "GET /compute/v2.1/servers/421dc68a-3adc-4486-a2e2-5fb37376d936" status: 200 len: 1504 microversion: 2.1 time: 0.158230 Jul 01 04:16:30.752685 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 499/1009] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:16:30 2022] GET /compute/v2.1/servers/421dc68a-3adc-4486-a2e2-5fb37376d936 => generated 1504 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:16:31.773893 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-fd6fad57-035a-44dc-8e55-5d9a65f7bc8f tempest-VolumesActionsTest-1466645267 tempest-VolumesActionsTest-1466645267-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:16:31.774598 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-fd6fad57-035a-44dc-8e55-5d9a65f7bc8f tempest-VolumesActionsTest-1466645267 tempest-VolumesActionsTest-1466645267-project] [instance: 421dc68a-3adc-4486-a2e2-5fb37376d936] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:16:31.781086 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-fd6fad57-035a-44dc-8e55-5d9a65f7bc8f tempest-VolumesActionsTest-1466645267 tempest-VolumesActionsTest-1466645267-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:16:31.781540 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-fd6fad57-035a-44dc-8e55-5d9a65f7bc8f tempest-VolumesActionsTest-1466645267 tempest-VolumesActionsTest-1466645267-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:16:31.782318 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-fd6fad57-035a-44dc-8e55-5d9a65f7bc8f tempest-VolumesActionsTest-1466645267 tempest-VolumesActionsTest-1466645267-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:16:31.782761 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-fd6fad57-035a-44dc-8e55-5d9a65f7bc8f tempest-VolumesActionsTest-1466645267 tempest-VolumesActionsTest-1466645267-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:16:31.916382 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-fd6fad57-035a-44dc-8e55-5d9a65f7bc8f tempest-VolumesActionsTest-1466645267 tempest-VolumesActionsTest-1466645267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90fc6c2d12f3420eb7d646d7fceb8965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f7e5a8b43740ab8cd82b939a8af457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:16:31.924514 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-fd6fad57-035a-44dc-8e55-5d9a65f7bc8f tempest-VolumesActionsTest-1466645267 tempest-VolumesActionsTest-1466645267-project] 10.222.0.20 "GET /compute/v2.1/servers/421dc68a-3adc-4486-a2e2-5fb37376d936" status: 200 len: 1504 microversion: 2.1 time: 0.155384 Jul 01 04:16:31.925088 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 511/1010] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:16:31 2022] GET /compute/v2.1/servers/421dc68a-3adc-4486-a2e2-5fb37376d936 => generated 1504 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:16:32.499207 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-ff43f406-219e-4844-bf01-ba9519c4730f tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:16:32.500244 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-ff43f406-219e-4844-bf01-ba9519c4730f tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] [instance: 20264c61-166b-4dce-9121-d530cedf677f] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:16:32.506743 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-ff43f406-219e-4844-bf01-ba9519c4730f tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:16:32.507188 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-ff43f406-219e-4844-bf01-ba9519c4730f tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:16:32.508613 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-ff43f406-219e-4844-bf01-ba9519c4730f tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:16:32.509048 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-ff43f406-219e-4844-bf01-ba9519c4730f tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:16:32.538510 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-ff43f406-219e-4844-bf01-ba9519c4730f tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] 10.222.0.20 "GET /compute/v2.1/servers/20264c61-166b-4dce-9121-d530cedf677f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043147 Jul 01 04:16:32.539066 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 500/1011] 10.222.0.20 () {58 vars in 1301 bytes} [Fri Jul 1 04:16:32 2022] GET /compute/v2.1/servers/20264c61-166b-4dce-9121-d530cedf677f/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 01 04:16:32.608728 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [req-560179be-8511-4915-8a58-264060cbf2a2 req-cbbc607e-0604-43a3-9335-4691c65771ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "421dc68a-3adc-4486-a2e2-5fb37376d936", "name": "network-vif-deleted", "tag": "0bd4bfdd-e8ba-44e9-a80f-00513ead81dc"}]} {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 04:16:32.617906 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [req-560179be-8511-4915-8a58-264060cbf2a2 req-cbbc607e-0604-43a3-9335-4691c65771ae service nova] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:16:32.618458 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [req-560179be-8511-4915-8a58-264060cbf2a2 req-cbbc607e-0604-43a3-9335-4691c65771ae service nova] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:16:32.631169 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.compute.server_external_events [req-560179be-8511-4915-8a58-264060cbf2a2 req-cbbc607e-0604-43a3-9335-4691c65771ae service nova] Creating event network-vif-deleted:0bd4bfdd-e8ba-44e9-a80f-00513ead81dc for instance 421dc68a-3adc-4486-a2e2-5fb37376d936 on hv-cinder-84684 Jul 01 04:16:32.637039 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [req-560179be-8511-4915-8a58-264060cbf2a2 req-cbbc607e-0604-43a3-9335-4691c65771ae service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032029 Jul 01 04:16:32.637770 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 512/1012] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Jul 1 04:16:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 04:16:32.652057 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-f4ac9c9e-f717-4cfc-b99a-6b73c44f3eda tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:16:32.653308 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-f4ac9c9e-f717-4cfc-b99a-6b73c44f3eda tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] [instance: 20264c61-166b-4dce-9121-d530cedf677f] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:16:32.659060 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-f4ac9c9e-f717-4cfc-b99a-6b73c44f3eda tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:16:32.663283 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-f4ac9c9e-f717-4cfc-b99a-6b73c44f3eda tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:16:32.663283 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-f4ac9c9e-f717-4cfc-b99a-6b73c44f3eda tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:16:32.663283 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-f4ac9c9e-f717-4cfc-b99a-6b73c44f3eda tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:16:32.690036 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-f4ac9c9e-f717-4cfc-b99a-6b73c44f3eda tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] 10.222.0.20 "GET /compute/v2.1/servers/20264c61-166b-4dce-9121-d530cedf677f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041844 Jul 01 04:16:32.696076 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 501/1013] 10.222.0.20 () {58 vars in 1301 bytes} [Fri Jul 1 04:16:32 2022] GET /compute/v2.1/servers/20264c61-166b-4dce-9121-d530cedf677f/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 01 04:16:32.756715 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-a8f47a5c-f7af-47ca-bb0a-f8d9dc07ba7e tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:16:32.757312 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-a8f47a5c-f7af-47ca-bb0a-f8d9dc07ba7e tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] [instance: 20264c61-166b-4dce-9121-d530cedf677f] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:16:32.763914 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-a8f47a5c-f7af-47ca-bb0a-f8d9dc07ba7e tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:16:32.764378 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-a8f47a5c-f7af-47ca-bb0a-f8d9dc07ba7e tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:16:32.765159 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-a8f47a5c-f7af-47ca-bb0a-f8d9dc07ba7e tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:16:32.765614 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-a8f47a5c-f7af-47ca-bb0a-f8d9dc07ba7e tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:16:32.792809 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-a8f47a5c-f7af-47ca-bb0a-f8d9dc07ba7e tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] [instance: 20264c61-166b-4dce-9121-d530cedf677f] Going to try to terminate instance {{(pid=118712) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 01 04:16:32.946923 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-c6e8394f-cee2-4259-adc4-841cc1c8a903 tempest-VolumesActionsTest-1466645267 tempest-VolumesActionsTest-1466645267-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:16:32.947581 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-c6e8394f-cee2-4259-adc4-841cc1c8a903 tempest-VolumesActionsTest-1466645267 tempest-VolumesActionsTest-1466645267-project] [instance: 421dc68a-3adc-4486-a2e2-5fb37376d936] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:16:32.953588 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-c6e8394f-cee2-4259-adc4-841cc1c8a903 tempest-VolumesActionsTest-1466645267 tempest-VolumesActionsTest-1466645267-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:16:32.954024 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-c6e8394f-cee2-4259-adc4-841cc1c8a903 tempest-VolumesActionsTest-1466645267 tempest-VolumesActionsTest-1466645267-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:16:32.954794 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-c6e8394f-cee2-4259-adc4-841cc1c8a903 tempest-VolumesActionsTest-1466645267 tempest-VolumesActionsTest-1466645267-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:16:32.955453 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-c6e8394f-cee2-4259-adc4-841cc1c8a903 tempest-VolumesActionsTest-1466645267 tempest-VolumesActionsTest-1466645267-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:16:32.995658 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-c6e8394f-cee2-4259-adc4-841cc1c8a903 tempest-VolumesActionsTest-1466645267 tempest-VolumesActionsTest-1466645267-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:16:32.996118 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-c6e8394f-cee2-4259-adc4-841cc1c8a903 tempest-VolumesActionsTest-1466645267 tempest-VolumesActionsTest-1466645267-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:16:32.996570 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.objects.instance [None req-c6e8394f-cee2-4259-adc4-841cc1c8a903 tempest-VolumesActionsTest-1466645267 tempest-VolumesActionsTest-1466645267-project] Lazy-loading 'fault' on Instance uuid 421dc68a-3adc-4486-a2e2-5fb37376d936 {{(pid=118711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 04:16:33.038507 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-c6e8394f-cee2-4259-adc4-841cc1c8a903 tempest-VolumesActionsTest-1466645267 tempest-VolumesActionsTest-1466645267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90fc6c2d12f3420eb7d646d7fceb8965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f7e5a8b43740ab8cd82b939a8af457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:16:33.047451 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-c6e8394f-cee2-4259-adc4-841cc1c8a903 tempest-VolumesActionsTest-1466645267 tempest-VolumesActionsTest-1466645267-project] 10.222.0.20 "GET /compute/v2.1/servers/421dc68a-3adc-4486-a2e2-5fb37376d936" status: 200 len: 1303 microversion: 2.1 time: 0.103869 Jul 01 04:16:33.047451 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 502/1014] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:16:32 2022] GET /compute/v2.1/servers/421dc68a-3adc-4486-a2e2-5fb37376d936 => generated 1303 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:16:33.106362 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-a8f47a5c-f7af-47ca-bb0a-f8d9dc07ba7e tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] 10.222.0.20 "DELETE /compute/v2.1/servers/20264c61-166b-4dce-9121-d530cedf677f" status: 204 len: 0 microversion: 2.1 time: 0.353693 Jul 01 04:16:33.106976 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 513/1015] 10.222.0.20 () {58 vars in 1238 bytes} [Fri Jul 1 04:16:32 2022] DELETE /compute/v2.1/servers/20264c61-166b-4dce-9121-d530cedf677f => generated 0 bytes in 355 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 01 04:16:33.115448 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-59af8629-ee31-4d53-948d-c8942621508b tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:16:33.116059 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-59af8629-ee31-4d53-948d-c8942621508b tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] [instance: 20264c61-166b-4dce-9121-d530cedf677f] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:16:33.122158 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-59af8629-ee31-4d53-948d-c8942621508b tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:16:33.122610 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-59af8629-ee31-4d53-948d-c8942621508b tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:16:33.123412 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-59af8629-ee31-4d53-948d-c8942621508b tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:16:33.123856 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-59af8629-ee31-4d53-948d-c8942621508b tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:16:33.250384 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-59af8629-ee31-4d53-948d-c8942621508b tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73d76a988462431fa6bb03dca64463a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9614129d1e864c3ea288aaac8387c5d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:16:33.258311 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-59af8629-ee31-4d53-948d-c8942621508b tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] 10.222.0.20 "GET /compute/v2.1/servers/20264c61-166b-4dce-9121-d530cedf677f" status: 200 len: 1672 microversion: 2.1 time: 0.146773 Jul 01 04:16:33.259074 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 503/1016] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:16:33 2022] GET /compute/v2.1/servers/20264c61-166b-4dce-9121-d530cedf677f => generated 1672 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:16:34.064592 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-a7c89547-153e-43e5-b7ff-05863ab8570d tempest-VolumesActionsTest-1466645267 tempest-VolumesActionsTest-1466645267-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:16:34.065303 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-a7c89547-153e-43e5-b7ff-05863ab8570d tempest-VolumesActionsTest-1466645267 tempest-VolumesActionsTest-1466645267-project] [instance: 421dc68a-3adc-4486-a2e2-5fb37376d936] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:16:34.067806 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG dbcounter [-] [118712] Writing DB stats nova_api:SELECT=85,nova_api:UPDATE=3,nova_api:INSERT=3 {{(pid=118712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:16:34.073417 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-a7c89547-153e-43e5-b7ff-05863ab8570d tempest-VolumesActionsTest-1466645267 tempest-VolumesActionsTest-1466645267-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:16:34.073881 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-a7c89547-153e-43e5-b7ff-05863ab8570d tempest-VolumesActionsTest-1466645267 tempest-VolumesActionsTest-1466645267-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:16:34.074659 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-a7c89547-153e-43e5-b7ff-05863ab8570d tempest-VolumesActionsTest-1466645267 tempest-VolumesActionsTest-1466645267-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:16:34.075106 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-a7c89547-153e-43e5-b7ff-05863ab8570d tempest-VolumesActionsTest-1466645267 tempest-VolumesActionsTest-1466645267-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:16:34.107351 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-a7c89547-153e-43e5-b7ff-05863ab8570d tempest-VolumesActionsTest-1466645267 tempest-VolumesActionsTest-1466645267-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:16:34.107813 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-a7c89547-153e-43e5-b7ff-05863ab8570d tempest-VolumesActionsTest-1466645267 tempest-VolumesActionsTest-1466645267-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:16:34.108276 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.objects.instance [None req-a7c89547-153e-43e5-b7ff-05863ab8570d tempest-VolumesActionsTest-1466645267 tempest-VolumesActionsTest-1466645267-project] Lazy-loading 'fault' on Instance uuid 421dc68a-3adc-4486-a2e2-5fb37376d936 {{(pid=118712) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 04:16:34.149750 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-a7c89547-153e-43e5-b7ff-05863ab8570d tempest-VolumesActionsTest-1466645267 tempest-VolumesActionsTest-1466645267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90fc6c2d12f3420eb7d646d7fceb8965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f7e5a8b43740ab8cd82b939a8af457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:16:34.157721 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-a7c89547-153e-43e5-b7ff-05863ab8570d tempest-VolumesActionsTest-1466645267 tempest-VolumesActionsTest-1466645267-project] 10.222.0.20 "GET /compute/v2.1/servers/421dc68a-3adc-4486-a2e2-5fb37376d936" status: 200 len: 1303 microversion: 2.1 time: 0.097489 Jul 01 04:16:34.158287 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 514/1017] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:16:34 2022] GET /compute/v2.1/servers/421dc68a-3adc-4486-a2e2-5fb37376d936 => generated 1303 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:16:34.275895 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-4c93669a-6c1d-4f62-a0e6-0995430ec3a6 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:16:34.276499 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-4c93669a-6c1d-4f62-a0e6-0995430ec3a6 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] [instance: 20264c61-166b-4dce-9121-d530cedf677f] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:16:34.282961 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-4c93669a-6c1d-4f62-a0e6-0995430ec3a6 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:16:34.283462 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-4c93669a-6c1d-4f62-a0e6-0995430ec3a6 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:16:34.284227 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-4c93669a-6c1d-4f62-a0e6-0995430ec3a6 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:16:34.284664 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-4c93669a-6c1d-4f62-a0e6-0995430ec3a6 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:16:34.414940 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-4c93669a-6c1d-4f62-a0e6-0995430ec3a6 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73d76a988462431fa6bb03dca64463a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9614129d1e864c3ea288aaac8387c5d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:16:34.422479 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-4c93669a-6c1d-4f62-a0e6-0995430ec3a6 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] 10.222.0.20 "GET /compute/v2.1/servers/20264c61-166b-4dce-9121-d530cedf677f" status: 200 len: 1672 microversion: 2.1 time: 0.150446 Jul 01 04:16:34.423029 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 504/1018] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:16:34 2022] GET /compute/v2.1/servers/20264c61-166b-4dce-9121-d530cedf677f => generated 1672 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:16:35.175945 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-48469d73-4c2e-487d-b3cb-76e4ecad06e5 tempest-VolumesActionsTest-1466645267 tempest-VolumesActionsTest-1466645267-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:16:35.176566 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-48469d73-4c2e-487d-b3cb-76e4ecad06e5 tempest-VolumesActionsTest-1466645267 tempest-VolumesActionsTest-1466645267-project] [instance: 421dc68a-3adc-4486-a2e2-5fb37376d936] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:16:35.182943 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-48469d73-4c2e-487d-b3cb-76e4ecad06e5 tempest-VolumesActionsTest-1466645267 tempest-VolumesActionsTest-1466645267-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:16:35.183442 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-48469d73-4c2e-487d-b3cb-76e4ecad06e5 tempest-VolumesActionsTest-1466645267 tempest-VolumesActionsTest-1466645267-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:16:35.184227 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-48469d73-4c2e-487d-b3cb-76e4ecad06e5 tempest-VolumesActionsTest-1466645267 tempest-VolumesActionsTest-1466645267-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:16:35.184679 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-48469d73-4c2e-487d-b3cb-76e4ecad06e5 tempest-VolumesActionsTest-1466645267 tempest-VolumesActionsTest-1466645267-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:16:35.202493 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.wsgi [None req-48469d73-4c2e-487d-b3cb-76e4ecad06e5 tempest-VolumesActionsTest-1466645267 tempest-VolumesActionsTest-1466645267-project] HTTP exception thrown: Instance 421dc68a-3adc-4486-a2e2-5fb37376d936 could not be found. Jul 01 04:16:35.204203 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-48469d73-4c2e-487d-b3cb-76e4ecad06e5 tempest-VolumesActionsTest-1466645267 tempest-VolumesActionsTest-1466645267-project] Request method failure captured: Jul 01 04:16:35.204203 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: request: GET /compute/v2.1/servers/421dc68a-3adc-4486-a2e2-5fb37376d936 HTTP/1.1 Jul 01 04:16:35.204203 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: Accept: application/json Jul 01 04:16:35.204203 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: Accept-Encoding: identity Jul 01 04:16:35.204203 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: Connection: close Jul 01 04:16:35.204203 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: Content-Length: 0 Jul 01 04:16:35.204203 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: Content-Type: application/json Jul 01 04:16:35.204203 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: Host: 10.222.0.20 Jul 01 04:16:35.204203 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: Openstack-System-Scope: None Jul 01 04:16:35.204203 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: User-Agent: python-urllib3/1.26.9 Jul 01 04:16:35.204203 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Auth-Token: gAAAAABivnT-9XbPuOIx67mkFfDXwhFsnvtQ0a9rw5MkHkAKd0hEO8ALMVnr7qrwMf8BMiIgmwyETkoJrQlFw35MPKK6rOoR5Tqav5jQeQOMvUriY95_eSk9k2esshZArPPU2QQEyBc6ukYtIw1bJYMWUufpXgVDzIaU8DYGv2O07D9FUcvm8bc Jul 01 04:16:35.204203 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Domain-Id: None Jul 01 04:16:35.204203 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Domain-Name: None Jul 01 04:16:35.204203 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Identity-Status: Confirmed Jul 01 04:16:35.204203 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Is-Admin-Project: True Jul 01 04:16:35.204203 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Project-Domain-Id: default Jul 01 04:16:35.204203 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Project-Domain-Name: Default Jul 01 04:16:35.204203 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Project-Id: a9f7e5a8b43740ab8cd82b939a8af457 Jul 01 04:16:35.204203 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Project-Name: tempest-VolumesActionsTest-1466645267 Jul 01 04:16:35.204203 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Role: reader,member Jul 01 04:16:35.204203 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Roles: reader,member Jul 01 04:16:35.205659 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/a9f7e5a8b43740ab8cd82b939a8af457"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_a9f7e5a8b43740ab8cd82b939a8af457", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a9f7e5a8b43740ab8cd82b939a8af457"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a9f7e5a8b43740ab8cd82b939a8af457"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}] Jul 01 04:16:35.205659 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Tenant: tempest-VolumesActionsTest-1466645267 Jul 01 04:16:35.205659 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Tenant-Id: a9f7e5a8b43740ab8cd82b939a8af457 Jul 01 04:16:35.205659 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Tenant-Name: tempest-VolumesActionsTest-1466645267 Jul 01 04:16:35.205659 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-User: tempest-VolumesActionsTest-1466645267-project Jul 01 04:16:35.205659 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-User-Domain-Id: default Jul 01 04:16:35.205659 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-User-Domain-Name: Default Jul 01 04:16:35.205659 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-User-Id: 90fc6c2d12f3420eb7d646d7fceb8965 Jul 01 04:16:35.205659 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-User-Name: tempest-VolumesActionsTest-1466645267-project Jul 01 04:16:35.205659 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: method: > Jul 01 04:16:35.205659 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: exception: Instance 421dc68a-3adc-4486-a2e2-5fb37376d936 could not be found. Jul 01 04:16:35.205659 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: action_args: {'id': '421dc68a-3adc-4486-a2e2-5fb37376d936'} Jul 01 04:16:35.206591 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 04:16:35.206591 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 04:16:35.206591 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 04:16:35.206591 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 04:16:35.206591 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 04:16:35.206591 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 04:16:35.206591 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 04:16:35.206591 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 04:16:35.206591 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 04:16:35.206591 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 04:16:35.206591 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 421dc68a-3adc-4486-a2e2-5fb37376d936 could not be found. Jul 01 04:16:35.206591 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi Jul 01 04:16:35.206591 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 04:16:35.206591 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi Jul 01 04:16:35.206591 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 04:16:35.206591 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 04:16:35.206591 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 04:16:35.206591 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 04:16:35.206591 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 04:16:35.206591 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 04:16:35.208278 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 04:16:35.208278 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 04:16:35.208278 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 04:16:35.208278 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 04:16:35.208278 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 04:16:35.208278 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 04:16:35.208278 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 04:16:35.208278 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 421dc68a-3adc-4486-a2e2-5fb37376d936 could not be found. Jul 01 04:16:35.208278 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi Jul 01 04:16:35.208278 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 04:16:35.208278 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi Jul 01 04:16:35.208278 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 04:16:35.208278 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 04:16:35.208278 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 04:16:35.208278 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 04:16:35.208278 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 04:16:35.208278 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 421dc68a-3adc-4486-a2e2-5fb37376d936 could not be found. Jul 01 04:16:35.208278 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi Jul 01 04:16:35.209937 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-48469d73-4c2e-487d-b3cb-76e4ecad06e5 tempest-VolumesActionsTest-1466645267 tempest-VolumesActionsTest-1466645267-project] Returning 404 to user: Instance 421dc68a-3adc-4486-a2e2-5fb37376d936 could not be found. {{(pid=118712) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 04:16:35.209937 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-48469d73-4c2e-487d-b3cb-76e4ecad06e5 tempest-VolumesActionsTest-1466645267 tempest-VolumesActionsTest-1466645267-project] 10.222.0.20 "GET /compute/v2.1/servers/421dc68a-3adc-4486-a2e2-5fb37376d936" status: 404 len: 111 microversion: 2.1 time: 0.034295 Jul 01 04:16:35.209937 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 515/1019] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:16:35 2022] GET /compute/v2.1/servers/421dc68a-3adc-4486-a2e2-5fb37376d936 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 04:16:35.440338 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-4d5d3c92-9f5a-41ba-9738-11cdbc483a14 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:16:35.441027 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-4d5d3c92-9f5a-41ba-9738-11cdbc483a14 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] [instance: 20264c61-166b-4dce-9121-d530cedf677f] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:16:35.448542 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-4d5d3c92-9f5a-41ba-9738-11cdbc483a14 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:16:35.449001 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-4d5d3c92-9f5a-41ba-9738-11cdbc483a14 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:16:35.449768 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-4d5d3c92-9f5a-41ba-9738-11cdbc483a14 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:16:35.450208 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-4d5d3c92-9f5a-41ba-9738-11cdbc483a14 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:16:35.690931 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-4d5d3c92-9f5a-41ba-9738-11cdbc483a14 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73d76a988462431fa6bb03dca64463a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9614129d1e864c3ea288aaac8387c5d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:16:35.698864 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-4d5d3c92-9f5a-41ba-9738-11cdbc483a14 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] 10.222.0.20 "GET /compute/v2.1/servers/20264c61-166b-4dce-9121-d530cedf677f" status: 200 len: 1672 microversion: 2.1 time: 0.262404 Jul 01 04:16:35.699477 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 505/1020] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:16:35 2022] GET /compute/v2.1/servers/20264c61-166b-4dce-9121-d530cedf677f => generated 1672 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:16:36.172756 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [req-0bc10826-fcec-45e3-851f-ba50fa5a061c req-8377f1b2-9197-4aff-a4a0-f244b03b1493 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20264c61-166b-4dce-9121-d530cedf677f", "name": "network-vif-deleted", "tag": "43920b00-11fc-46a2-8809-9dc05269c7c4"}]} {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 04:16:36.176255 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [req-0bc10826-fcec-45e3-851f-ba50fa5a061c req-8377f1b2-9197-4aff-a4a0-f244b03b1493 service nova] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:16:36.176890 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [req-0bc10826-fcec-45e3-851f-ba50fa5a061c req-8377f1b2-9197-4aff-a4a0-f244b03b1493 service nova] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:16:36.190192 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.compute.server_external_events [req-0bc10826-fcec-45e3-851f-ba50fa5a061c req-8377f1b2-9197-4aff-a4a0-f244b03b1493 service nova] Creating event network-vif-deleted:43920b00-11fc-46a2-8809-9dc05269c7c4 for instance 20264c61-166b-4dce-9121-d530cedf677f on hv-cinder-84684 Jul 01 04:16:36.196263 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [req-0bc10826-fcec-45e3-851f-ba50fa5a061c req-8377f1b2-9197-4aff-a4a0-f244b03b1493 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041212 Jul 01 04:16:36.196886 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 516/1021] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Jul 1 04:16:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 04:16:36.716898 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-7a068383-dd20-466c-a1bd-195759be5960 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:16:36.722558 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-7a068383-dd20-466c-a1bd-195759be5960 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] [instance: 20264c61-166b-4dce-9121-d530cedf677f] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:16:36.727681 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-7a068383-dd20-466c-a1bd-195759be5960 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:16:36.728127 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-7a068383-dd20-466c-a1bd-195759be5960 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:16:36.728895 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-7a068383-dd20-466c-a1bd-195759be5960 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:16:36.729538 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-7a068383-dd20-466c-a1bd-195759be5960 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:16:36.765232 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-7a068383-dd20-466c-a1bd-195759be5960 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:16:36.765895 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-7a068383-dd20-466c-a1bd-195759be5960 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:16:36.766346 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.objects.instance [None req-7a068383-dd20-466c-a1bd-195759be5960 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lazy-loading 'fault' on Instance uuid 20264c61-166b-4dce-9121-d530cedf677f {{(pid=118711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 04:16:36.808062 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-7a068383-dd20-466c-a1bd-195759be5960 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73d76a988462431fa6bb03dca64463a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9614129d1e864c3ea288aaac8387c5d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:16:36.816612 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-7a068383-dd20-466c-a1bd-195759be5960 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] 10.222.0.20 "GET /compute/v2.1/servers/20264c61-166b-4dce-9121-d530cedf677f" status: 200 len: 1326 microversion: 2.1 time: 0.103380 Jul 01 04:16:36.827075 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 506/1022] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:16:36 2022] GET /compute/v2.1/servers/20264c61-166b-4dce-9121-d530cedf677f => generated 1326 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:16:37.835825 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-bac8a0e6-aff2-4798-8de0-986c3e00eb49 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:16:37.836576 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-bac8a0e6-aff2-4798-8de0-986c3e00eb49 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] [instance: 20264c61-166b-4dce-9121-d530cedf677f] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:16:37.842992 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-bac8a0e6-aff2-4798-8de0-986c3e00eb49 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:16:37.843497 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-bac8a0e6-aff2-4798-8de0-986c3e00eb49 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:16:37.844287 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-bac8a0e6-aff2-4798-8de0-986c3e00eb49 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:16:37.844732 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-bac8a0e6-aff2-4798-8de0-986c3e00eb49 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:16:37.877153 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-bac8a0e6-aff2-4798-8de0-986c3e00eb49 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:16:37.877635 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-bac8a0e6-aff2-4798-8de0-986c3e00eb49 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:16:37.878142 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.objects.instance [None req-bac8a0e6-aff2-4798-8de0-986c3e00eb49 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lazy-loading 'fault' on Instance uuid 20264c61-166b-4dce-9121-d530cedf677f {{(pid=118712) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 04:16:37.923622 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-bac8a0e6-aff2-4798-8de0-986c3e00eb49 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73d76a988462431fa6bb03dca64463a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9614129d1e864c3ea288aaac8387c5d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:16:37.931086 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-bac8a0e6-aff2-4798-8de0-986c3e00eb49 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] 10.222.0.20 "GET /compute/v2.1/servers/20264c61-166b-4dce-9121-d530cedf677f" status: 200 len: 1326 microversion: 2.1 time: 0.100060 Jul 01 04:16:37.931680 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 517/1023] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:16:37 2022] GET /compute/v2.1/servers/20264c61-166b-4dce-9121-d530cedf677f => generated 1326 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:16:38.949068 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-dac868d0-aba8-40f7-85a1-112d95965176 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:16:38.949720 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-dac868d0-aba8-40f7-85a1-112d95965176 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] [instance: 20264c61-166b-4dce-9121-d530cedf677f] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:16:38.956265 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-dac868d0-aba8-40f7-85a1-112d95965176 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:16:38.956721 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-dac868d0-aba8-40f7-85a1-112d95965176 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:16:38.957487 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-dac868d0-aba8-40f7-85a1-112d95965176 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:16:38.957929 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-dac868d0-aba8-40f7-85a1-112d95965176 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:16:38.972617 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.wsgi [None req-dac868d0-aba8-40f7-85a1-112d95965176 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] HTTP exception thrown: Instance 20264c61-166b-4dce-9121-d530cedf677f could not be found. Jul 01 04:16:38.974167 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-dac868d0-aba8-40f7-85a1-112d95965176 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Request method failure captured: Jul 01 04:16:38.974167 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: request: GET /compute/v2.1/servers/20264c61-166b-4dce-9121-d530cedf677f HTTP/1.1 Jul 01 04:16:38.974167 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: Accept: application/json Jul 01 04:16:38.974167 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: Accept-Encoding: identity Jul 01 04:16:38.974167 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: Connection: close Jul 01 04:16:38.974167 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: Content-Length: 0 Jul 01 04:16:38.974167 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: Content-Type: application/json Jul 01 04:16:38.974167 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: Host: 10.222.0.20 Jul 01 04:16:38.974167 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: Openstack-System-Scope: None Jul 01 04:16:38.974167 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: User-Agent: python-urllib3/1.26.9 Jul 01 04:16:38.974167 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-Auth-Token: gAAAAABivnQhBYAO9PNA930KsaYPgDPjv2L4uIu6ObYzCjMzkLGwQYsPy6iHjK1QEG6tUpDuhNy6GRQbAGDaT8BkVKQ19TstKXrsmZ9U3f_tiqi-7Aap4Qgv-AWKQLYpGLFR8YqULb2p1N7vBmZMZvjQPe0nAdgt2UjyXGoi7zYaI6UFjR5KpQg Jul 01 04:16:38.974167 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-Domain-Id: None Jul 01 04:16:38.974167 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-Domain-Name: None Jul 01 04:16:38.974167 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-Identity-Status: Confirmed Jul 01 04:16:38.974167 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-Is-Admin-Project: True Jul 01 04:16:38.974167 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-Project-Domain-Id: default Jul 01 04:16:38.974167 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-Project-Domain-Name: Default Jul 01 04:16:38.974167 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-Project-Id: 9614129d1e864c3ea288aaac8387c5d1 Jul 01 04:16:38.974167 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-Project-Name: tempest-AttachVolumeTestJSON-416529265 Jul 01 04:16:38.974167 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-Role: reader,member Jul 01 04:16:38.974167 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-Roles: reader,member Jul 01 04:16:38.975857 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/9614129d1e864c3ea288aaac8387c5d1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_9614129d1e864c3ea288aaac8387c5d1", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9614129d1e864c3ea288aaac8387c5d1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9614129d1e864c3ea288aaac8387c5d1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}] Jul 01 04:16:38.975857 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-Tenant: tempest-AttachVolumeTestJSON-416529265 Jul 01 04:16:38.975857 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-Tenant-Id: 9614129d1e864c3ea288aaac8387c5d1 Jul 01 04:16:38.975857 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-Tenant-Name: tempest-AttachVolumeTestJSON-416529265 Jul 01 04:16:38.975857 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-User: tempest-AttachVolumeTestJSON-416529265-project Jul 01 04:16:38.975857 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-User-Domain-Id: default Jul 01 04:16:38.975857 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-User-Domain-Name: Default Jul 01 04:16:38.975857 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-User-Id: 73d76a988462431fa6bb03dca64463a4 Jul 01 04:16:38.975857 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-User-Name: tempest-AttachVolumeTestJSON-416529265-project Jul 01 04:16:38.975857 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: method: > Jul 01 04:16:38.975857 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: exception: Instance 20264c61-166b-4dce-9121-d530cedf677f could not be found. Jul 01 04:16:38.975857 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: action_args: {'id': '20264c61-166b-4dce-9121-d530cedf677f'} Jul 01 04:16:38.976738 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 04:16:38.976738 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 04:16:38.976738 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 04:16:38.976738 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 04:16:38.976738 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 04:16:38.976738 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 04:16:38.976738 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 04:16:38.976738 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 04:16:38.976738 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 04:16:38.976738 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 04:16:38.976738 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 20264c61-166b-4dce-9121-d530cedf677f could not be found. Jul 01 04:16:38.976738 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi Jul 01 04:16:38.976738 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 04:16:38.976738 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi Jul 01 04:16:38.976738 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 04:16:38.976738 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 04:16:38.976738 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 04:16:38.976738 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 04:16:38.976738 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 04:16:38.976738 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 04:16:38.978202 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 04:16:38.978202 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 04:16:38.978202 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 04:16:38.978202 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 04:16:38.978202 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 04:16:38.978202 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 04:16:38.978202 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 04:16:38.978202 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 20264c61-166b-4dce-9121-d530cedf677f could not be found. Jul 01 04:16:38.978202 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi Jul 01 04:16:38.978202 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 04:16:38.978202 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi Jul 01 04:16:38.978202 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 04:16:38.978202 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 04:16:38.978202 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 04:16:38.978202 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 04:16:38.978202 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 04:16:38.978202 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 20264c61-166b-4dce-9121-d530cedf677f could not be found. Jul 01 04:16:38.978202 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi Jul 01 04:16:38.979590 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-dac868d0-aba8-40f7-85a1-112d95965176 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Returning 404 to user: Instance 20264c61-166b-4dce-9121-d530cedf677f could not be found. {{(pid=118711) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 04:16:38.979590 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-dac868d0-aba8-40f7-85a1-112d95965176 tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] 10.222.0.20 "GET /compute/v2.1/servers/20264c61-166b-4dce-9121-d530cedf677f" status: 404 len: 111 microversion: 2.1 time: 0.031106 Jul 01 04:16:38.979590 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 507/1024] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:16:38 2022] GET /compute/v2.1/servers/20264c61-166b-4dce-9121-d530cedf677f => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 04:16:38.984694 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-e2572431-1e3c-45a7-bf0c-4a279475100f tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Calling method '.version_select at 0x7f99a0754160>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:16:39.039376 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-e2572431-1e3c-45a7-bf0c-4a279475100f tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-683956672" status: 202 len: 0 microversion: 2.1 time: 0.057918 Jul 01 04:16:39.039953 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 518/1025] 10.222.0.20 () {58 vars in 1217 bytes} [Fri Jul 1 04:16:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-683956672 => generated 0 bytes in 60 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 04:16:42.315059 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-4470344e-8bd8-4d6c-a1cf-714c0d16104b tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:16:42.315620 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-4470344e-8bd8-4d6c-a1cf-714c0d16104b tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] [instance: 20264c61-166b-4dce-9121-d530cedf677f] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:16:42.335743 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-4470344e-8bd8-4d6c-a1cf-714c0d16104b tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:16:42.336190 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-4470344e-8bd8-4d6c-a1cf-714c0d16104b tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:16:42.337441 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-4470344e-8bd8-4d6c-a1cf-714c0d16104b tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:16:42.338058 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-4470344e-8bd8-4d6c-a1cf-714c0d16104b tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:16:42.359073 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.wsgi [None req-4470344e-8bd8-4d6c-a1cf-714c0d16104b tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] HTTP exception thrown: Instance 20264c61-166b-4dce-9121-d530cedf677f could not be found. Jul 01 04:16:42.360925 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-4470344e-8bd8-4d6c-a1cf-714c0d16104b tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Request method failure captured: Jul 01 04:16:42.360925 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: request: DELETE /compute/v2.1/servers/20264c61-166b-4dce-9121-d530cedf677f HTTP/1.1 Jul 01 04:16:42.360925 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: Accept: application/json Jul 01 04:16:42.360925 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: Accept-Encoding: identity Jul 01 04:16:42.360925 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: Connection: close Jul 01 04:16:42.360925 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: Content-Length: 0 Jul 01 04:16:42.360925 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: Content-Type: application/json Jul 01 04:16:42.360925 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: Host: 10.222.0.20 Jul 01 04:16:42.360925 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: Openstack-System-Scope: None Jul 01 04:16:42.360925 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: User-Agent: python-urllib3/1.26.9 Jul 01 04:16:42.360925 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-Auth-Token: gAAAAABivnQhBYAO9PNA930KsaYPgDPjv2L4uIu6ObYzCjMzkLGwQYsPy6iHjK1QEG6tUpDuhNy6GRQbAGDaT8BkVKQ19TstKXrsmZ9U3f_tiqi-7Aap4Qgv-AWKQLYpGLFR8YqULb2p1N7vBmZMZvjQPe0nAdgt2UjyXGoi7zYaI6UFjR5KpQg Jul 01 04:16:42.360925 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-Domain-Id: None Jul 01 04:16:42.360925 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-Domain-Name: None Jul 01 04:16:42.360925 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-Identity-Status: Confirmed Jul 01 04:16:42.360925 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-Is-Admin-Project: True Jul 01 04:16:42.360925 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-Project-Domain-Id: default Jul 01 04:16:42.360925 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-Project-Domain-Name: Default Jul 01 04:16:42.360925 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-Project-Id: 9614129d1e864c3ea288aaac8387c5d1 Jul 01 04:16:42.360925 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-Project-Name: tempest-AttachVolumeTestJSON-416529265 Jul 01 04:16:42.360925 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-Role: reader,member Jul 01 04:16:42.360925 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-Roles: reader,member Jul 01 04:16:42.362477 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/9614129d1e864c3ea288aaac8387c5d1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_9614129d1e864c3ea288aaac8387c5d1", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9614129d1e864c3ea288aaac8387c5d1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9614129d1e864c3ea288aaac8387c5d1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}] Jul 01 04:16:42.362477 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-Tenant: tempest-AttachVolumeTestJSON-416529265 Jul 01 04:16:42.362477 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-Tenant-Id: 9614129d1e864c3ea288aaac8387c5d1 Jul 01 04:16:42.362477 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-Tenant-Name: tempest-AttachVolumeTestJSON-416529265 Jul 01 04:16:42.362477 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-User: tempest-AttachVolumeTestJSON-416529265-project Jul 01 04:16:42.362477 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-User-Domain-Id: default Jul 01 04:16:42.362477 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-User-Domain-Name: Default Jul 01 04:16:42.362477 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-User-Id: 73d76a988462431fa6bb03dca64463a4 Jul 01 04:16:42.362477 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-User-Name: tempest-AttachVolumeTestJSON-416529265-project Jul 01 04:16:42.362477 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: method: > Jul 01 04:16:42.362477 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: exception: Instance 20264c61-166b-4dce-9121-d530cedf677f could not be found. Jul 01 04:16:42.362477 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: action_args: {'id': '20264c61-166b-4dce-9121-d530cedf677f'} Jul 01 04:16:42.363303 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 04:16:42.363303 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 04:16:42.363303 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 04:16:42.363303 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 04:16:42.363303 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 04:16:42.363303 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 04:16:42.363303 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 04:16:42.363303 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 04:16:42.363303 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 04:16:42.363303 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 04:16:42.363303 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 20264c61-166b-4dce-9121-d530cedf677f could not be found. Jul 01 04:16:42.363303 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi Jul 01 04:16:42.363303 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 04:16:42.363303 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi Jul 01 04:16:42.363303 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 04:16:42.363303 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 04:16:42.363303 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 04:16:42.363303 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 04:16:42.363303 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 04:16:42.363303 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 04:16:42.364608 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 04:16:42.364608 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 01 04:16:42.364608 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 01 04:16:42.364608 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 01 04:16:42.364608 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 01 04:16:42.364608 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 04:16:42.364608 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 04:16:42.364608 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 04:16:42.364608 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 04:16:42.364608 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 20264c61-166b-4dce-9121-d530cedf677f could not be found. Jul 01 04:16:42.364608 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi Jul 01 04:16:42.364608 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 04:16:42.364608 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi Jul 01 04:16:42.364608 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 04:16:42.364608 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 04:16:42.364608 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 04:16:42.364608 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 04:16:42.364608 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 04:16:42.364608 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 20264c61-166b-4dce-9121-d530cedf677f could not be found. Jul 01 04:16:42.364608 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi Jul 01 04:16:42.368969 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-4470344e-8bd8-4d6c-a1cf-714c0d16104b tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Returning 404 to user: Instance 20264c61-166b-4dce-9121-d530cedf677f could not be found. {{(pid=118711) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 04:16:42.370533 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-4470344e-8bd8-4d6c-a1cf-714c0d16104b tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] 10.222.0.20 "DELETE /compute/v2.1/servers/20264c61-166b-4dce-9121-d530cedf677f" status: 404 len: 111 microversion: 2.1 time: 0.060648 Jul 01 04:16:42.371321 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 508/1026] 10.222.0.20 () {58 vars in 1238 bytes} [Fri Jul 1 04:16:42 2022] DELETE /compute/v2.1/servers/20264c61-166b-4dce-9121-d530cedf677f => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 04:16:42.380092 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-138dce0d-4654-440a-b4b9-a4bc6a3a507b tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:16:42.380819 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-138dce0d-4654-440a-b4b9-a4bc6a3a507b tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] [instance: 20264c61-166b-4dce-9121-d530cedf677f] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:16:42.388042 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-138dce0d-4654-440a-b4b9-a4bc6a3a507b tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:16:42.388781 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-138dce0d-4654-440a-b4b9-a4bc6a3a507b tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:16:42.389607 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-138dce0d-4654-440a-b4b9-a4bc6a3a507b tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:16:42.390025 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-138dce0d-4654-440a-b4b9-a4bc6a3a507b tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:16:42.410052 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.wsgi [None req-138dce0d-4654-440a-b4b9-a4bc6a3a507b tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] HTTP exception thrown: Instance 20264c61-166b-4dce-9121-d530cedf677f could not be found. Jul 01 04:16:42.411765 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-138dce0d-4654-440a-b4b9-a4bc6a3a507b tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Request method failure captured: Jul 01 04:16:42.411765 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: request: GET /compute/v2.1/servers/20264c61-166b-4dce-9121-d530cedf677f HTTP/1.1 Jul 01 04:16:42.411765 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: Accept: application/json Jul 01 04:16:42.411765 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: Accept-Encoding: identity Jul 01 04:16:42.411765 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: Connection: close Jul 01 04:16:42.411765 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: Content-Length: 0 Jul 01 04:16:42.411765 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: Content-Type: application/json Jul 01 04:16:42.411765 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: Host: 10.222.0.20 Jul 01 04:16:42.411765 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: Openstack-System-Scope: None Jul 01 04:16:42.411765 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: User-Agent: python-urllib3/1.26.9 Jul 01 04:16:42.411765 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Auth-Token: gAAAAABivnQhBYAO9PNA930KsaYPgDPjv2L4uIu6ObYzCjMzkLGwQYsPy6iHjK1QEG6tUpDuhNy6GRQbAGDaT8BkVKQ19TstKXrsmZ9U3f_tiqi-7Aap4Qgv-AWKQLYpGLFR8YqULb2p1N7vBmZMZvjQPe0nAdgt2UjyXGoi7zYaI6UFjR5KpQg Jul 01 04:16:42.411765 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Domain-Id: None Jul 01 04:16:42.411765 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Domain-Name: None Jul 01 04:16:42.411765 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Identity-Status: Confirmed Jul 01 04:16:42.411765 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Is-Admin-Project: True Jul 01 04:16:42.411765 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Project-Domain-Id: default Jul 01 04:16:42.411765 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Project-Domain-Name: Default Jul 01 04:16:42.411765 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Project-Id: 9614129d1e864c3ea288aaac8387c5d1 Jul 01 04:16:42.411765 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Project-Name: tempest-AttachVolumeTestJSON-416529265 Jul 01 04:16:42.411765 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Role: reader,member Jul 01 04:16:42.411765 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Roles: reader,member Jul 01 04:16:42.413266 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/9614129d1e864c3ea288aaac8387c5d1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_9614129d1e864c3ea288aaac8387c5d1", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9614129d1e864c3ea288aaac8387c5d1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9614129d1e864c3ea288aaac8387c5d1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}] Jul 01 04:16:42.413266 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Tenant: tempest-AttachVolumeTestJSON-416529265 Jul 01 04:16:42.413266 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Tenant-Id: 9614129d1e864c3ea288aaac8387c5d1 Jul 01 04:16:42.413266 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Tenant-Name: tempest-AttachVolumeTestJSON-416529265 Jul 01 04:16:42.413266 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-User: tempest-AttachVolumeTestJSON-416529265-project Jul 01 04:16:42.413266 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-User-Domain-Id: default Jul 01 04:16:42.413266 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-User-Domain-Name: Default Jul 01 04:16:42.413266 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-User-Id: 73d76a988462431fa6bb03dca64463a4 Jul 01 04:16:42.413266 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-User-Name: tempest-AttachVolumeTestJSON-416529265-project Jul 01 04:16:42.413266 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: method: > Jul 01 04:16:42.413266 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: exception: Instance 20264c61-166b-4dce-9121-d530cedf677f could not be found. Jul 01 04:16:42.413266 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: action_args: {'id': '20264c61-166b-4dce-9121-d530cedf677f'} Jul 01 04:16:42.418396 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 04:16:42.418396 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 04:16:42.418396 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 04:16:42.418396 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 04:16:42.418396 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 04:16:42.418396 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 04:16:42.418396 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 04:16:42.418396 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 04:16:42.418396 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 04:16:42.418396 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 04:16:42.418396 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 20264c61-166b-4dce-9121-d530cedf677f could not be found. Jul 01 04:16:42.418396 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi Jul 01 04:16:42.418396 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 04:16:42.418396 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi Jul 01 04:16:42.418396 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 04:16:42.418396 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 04:16:42.418396 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 04:16:42.418396 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 04:16:42.418396 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 04:16:42.418396 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 04:16:42.420299 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 04:16:42.420299 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 04:16:42.420299 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 04:16:42.420299 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 04:16:42.420299 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 04:16:42.420299 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 04:16:42.420299 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 04:16:42.420299 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 20264c61-166b-4dce-9121-d530cedf677f could not be found. Jul 01 04:16:42.420299 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi Jul 01 04:16:42.420299 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 04:16:42.420299 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi Jul 01 04:16:42.420299 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 04:16:42.420299 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 04:16:42.420299 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 04:16:42.420299 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 04:16:42.420299 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 04:16:42.420299 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 20264c61-166b-4dce-9121-d530cedf677f could not be found. Jul 01 04:16:42.420299 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi Jul 01 04:16:42.422576 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-138dce0d-4654-440a-b4b9-a4bc6a3a507b tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Returning 404 to user: Instance 20264c61-166b-4dce-9121-d530cedf677f could not be found. {{(pid=118712) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 04:16:42.422576 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-138dce0d-4654-440a-b4b9-a4bc6a3a507b tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] 10.222.0.20 "GET /compute/v2.1/servers/20264c61-166b-4dce-9121-d530cedf677f" status: 404 len: 111 microversion: 2.1 time: 0.037417 Jul 01 04:16:42.422576 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 519/1027] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:16:42 2022] GET /compute/v2.1/servers/20264c61-166b-4dce-9121-d530cedf677f => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 04:16:43.675804 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-64e6b802-b0e6-42b2-8c0d-d76d41c23eda tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:16:43.676344 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-64e6b802-b0e6-42b2-8c0d-d76d41c23eda tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] [instance: 2e5d1edc-dbae-41dd-ab34-aa954b62f390] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:16:43.682847 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-64e6b802-b0e6-42b2-8c0d-d76d41c23eda tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:16:43.683333 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-64e6b802-b0e6-42b2-8c0d-d76d41c23eda tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:16:43.684087 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-64e6b802-b0e6-42b2-8c0d-d76d41c23eda tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:16:43.684521 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-64e6b802-b0e6-42b2-8c0d-d76d41c23eda tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:16:43.698880 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.wsgi [None req-64e6b802-b0e6-42b2-8c0d-d76d41c23eda tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] HTTP exception thrown: Instance 2e5d1edc-dbae-41dd-ab34-aa954b62f390 could not be found. Jul 01 04:16:43.700436 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-64e6b802-b0e6-42b2-8c0d-d76d41c23eda tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Request method failure captured: Jul 01 04:16:43.700436 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: request: DELETE /compute/v2.1/servers/2e5d1edc-dbae-41dd-ab34-aa954b62f390 HTTP/1.1 Jul 01 04:16:43.700436 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: Accept: application/json Jul 01 04:16:43.700436 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: Accept-Encoding: identity Jul 01 04:16:43.700436 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: Connection: close Jul 01 04:16:43.700436 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: Content-Length: 0 Jul 01 04:16:43.700436 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: Content-Type: application/json Jul 01 04:16:43.700436 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: Host: 10.222.0.20 Jul 01 04:16:43.700436 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: Openstack-System-Scope: None Jul 01 04:16:43.700436 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: User-Agent: python-urllib3/1.26.9 Jul 01 04:16:43.700436 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-Auth-Token: gAAAAABivnQhBYAO9PNA930KsaYPgDPjv2L4uIu6ObYzCjMzkLGwQYsPy6iHjK1QEG6tUpDuhNy6GRQbAGDaT8BkVKQ19TstKXrsmZ9U3f_tiqi-7Aap4Qgv-AWKQLYpGLFR8YqULb2p1N7vBmZMZvjQPe0nAdgt2UjyXGoi7zYaI6UFjR5KpQg Jul 01 04:16:43.700436 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-Domain-Id: None Jul 01 04:16:43.700436 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-Domain-Name: None Jul 01 04:16:43.700436 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-Identity-Status: Confirmed Jul 01 04:16:43.700436 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-Is-Admin-Project: True Jul 01 04:16:43.700436 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-Project-Domain-Id: default Jul 01 04:16:43.700436 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-Project-Domain-Name: Default Jul 01 04:16:43.700436 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-Project-Id: 9614129d1e864c3ea288aaac8387c5d1 Jul 01 04:16:43.700436 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-Project-Name: tempest-AttachVolumeTestJSON-416529265 Jul 01 04:16:43.700436 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-Role: reader,member Jul 01 04:16:43.700436 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-Roles: reader,member Jul 01 04:16:43.701812 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/9614129d1e864c3ea288aaac8387c5d1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_9614129d1e864c3ea288aaac8387c5d1", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9614129d1e864c3ea288aaac8387c5d1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9614129d1e864c3ea288aaac8387c5d1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}] Jul 01 04:16:43.701812 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-Tenant: tempest-AttachVolumeTestJSON-416529265 Jul 01 04:16:43.701812 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-Tenant-Id: 9614129d1e864c3ea288aaac8387c5d1 Jul 01 04:16:43.701812 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-Tenant-Name: tempest-AttachVolumeTestJSON-416529265 Jul 01 04:16:43.701812 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-User: tempest-AttachVolumeTestJSON-416529265-project Jul 01 04:16:43.701812 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-User-Domain-Id: default Jul 01 04:16:43.701812 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-User-Domain-Name: Default Jul 01 04:16:43.701812 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-User-Id: 73d76a988462431fa6bb03dca64463a4 Jul 01 04:16:43.701812 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: X-User-Name: tempest-AttachVolumeTestJSON-416529265-project Jul 01 04:16:43.701812 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: method: > Jul 01 04:16:43.701812 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: exception: Instance 2e5d1edc-dbae-41dd-ab34-aa954b62f390 could not be found. Jul 01 04:16:43.701812 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: action_args: {'id': '2e5d1edc-dbae-41dd-ab34-aa954b62f390'} Jul 01 04:16:43.702713 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 04:16:43.702713 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 04:16:43.702713 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 04:16:43.702713 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 04:16:43.702713 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 04:16:43.702713 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 04:16:43.702713 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 04:16:43.702713 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 04:16:43.702713 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 04:16:43.702713 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 04:16:43.702713 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2e5d1edc-dbae-41dd-ab34-aa954b62f390 could not be found. Jul 01 04:16:43.702713 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi Jul 01 04:16:43.702713 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 04:16:43.702713 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi Jul 01 04:16:43.702713 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 04:16:43.702713 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 04:16:43.702713 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 04:16:43.702713 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 04:16:43.702713 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 04:16:43.702713 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 04:16:43.704392 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 04:16:43.704392 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 01 04:16:43.704392 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 01 04:16:43.704392 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 01 04:16:43.704392 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 01 04:16:43.704392 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 04:16:43.704392 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 04:16:43.704392 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 04:16:43.704392 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 04:16:43.704392 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2e5d1edc-dbae-41dd-ab34-aa954b62f390 could not be found. Jul 01 04:16:43.704392 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi Jul 01 04:16:43.704392 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 04:16:43.704392 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi Jul 01 04:16:43.704392 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 04:16:43.704392 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 04:16:43.704392 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 04:16:43.704392 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 04:16:43.704392 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 04:16:43.704392 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2e5d1edc-dbae-41dd-ab34-aa954b62f390 could not be found. Jul 01 04:16:43.704392 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: ERROR nova.api.openstack.wsgi Jul 01 04:16:43.706760 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-64e6b802-b0e6-42b2-8c0d-d76d41c23eda tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Returning 404 to user: Instance 2e5d1edc-dbae-41dd-ab34-aa954b62f390 could not be found. {{(pid=118711) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 04:16:43.706760 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-64e6b802-b0e6-42b2-8c0d-d76d41c23eda tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] 10.222.0.20 "DELETE /compute/v2.1/servers/2e5d1edc-dbae-41dd-ab34-aa954b62f390" status: 404 len: 111 microversion: 2.1 time: 0.030913 Jul 01 04:16:43.706760 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 509/1028] 10.222.0.20 () {58 vars in 1238 bytes} [Fri Jul 1 04:16:43 2022] DELETE /compute/v2.1/servers/2e5d1edc-dbae-41dd-ab34-aa954b62f390 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 04:16:43.710586 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-cffc9182-11a4-40e3-8068-bf50ee45c08e tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:16:43.712293 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-cffc9182-11a4-40e3-8068-bf50ee45c08e tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] [instance: 2e5d1edc-dbae-41dd-ab34-aa954b62f390] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:16:43.719124 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-cffc9182-11a4-40e3-8068-bf50ee45c08e tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:16:43.719645 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-cffc9182-11a4-40e3-8068-bf50ee45c08e tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:16:43.720450 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-cffc9182-11a4-40e3-8068-bf50ee45c08e tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:16:43.720895 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-cffc9182-11a4-40e3-8068-bf50ee45c08e tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:16:43.735583 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.wsgi [None req-cffc9182-11a4-40e3-8068-bf50ee45c08e tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] HTTP exception thrown: Instance 2e5d1edc-dbae-41dd-ab34-aa954b62f390 could not be found. Jul 01 04:16:43.737217 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-cffc9182-11a4-40e3-8068-bf50ee45c08e tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Request method failure captured: Jul 01 04:16:43.737217 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: request: GET /compute/v2.1/servers/2e5d1edc-dbae-41dd-ab34-aa954b62f390 HTTP/1.1 Jul 01 04:16:43.737217 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: Accept: application/json Jul 01 04:16:43.737217 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: Accept-Encoding: identity Jul 01 04:16:43.737217 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: Connection: close Jul 01 04:16:43.737217 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: Content-Length: 0 Jul 01 04:16:43.737217 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: Content-Type: application/json Jul 01 04:16:43.737217 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: Host: 10.222.0.20 Jul 01 04:16:43.737217 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: Openstack-System-Scope: None Jul 01 04:16:43.737217 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: User-Agent: python-urllib3/1.26.9 Jul 01 04:16:43.737217 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Auth-Token: gAAAAABivnQhBYAO9PNA930KsaYPgDPjv2L4uIu6ObYzCjMzkLGwQYsPy6iHjK1QEG6tUpDuhNy6GRQbAGDaT8BkVKQ19TstKXrsmZ9U3f_tiqi-7Aap4Qgv-AWKQLYpGLFR8YqULb2p1N7vBmZMZvjQPe0nAdgt2UjyXGoi7zYaI6UFjR5KpQg Jul 01 04:16:43.737217 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Domain-Id: None Jul 01 04:16:43.737217 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Domain-Name: None Jul 01 04:16:43.737217 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Identity-Status: Confirmed Jul 01 04:16:43.737217 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Is-Admin-Project: True Jul 01 04:16:43.737217 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Project-Domain-Id: default Jul 01 04:16:43.737217 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Project-Domain-Name: Default Jul 01 04:16:43.737217 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Project-Id: 9614129d1e864c3ea288aaac8387c5d1 Jul 01 04:16:43.737217 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Project-Name: tempest-AttachVolumeTestJSON-416529265 Jul 01 04:16:43.737217 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Role: reader,member Jul 01 04:16:43.737217 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Roles: reader,member Jul 01 04:16:43.738849 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/9614129d1e864c3ea288aaac8387c5d1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_9614129d1e864c3ea288aaac8387c5d1", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9614129d1e864c3ea288aaac8387c5d1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9614129d1e864c3ea288aaac8387c5d1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}] Jul 01 04:16:43.738849 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Tenant: tempest-AttachVolumeTestJSON-416529265 Jul 01 04:16:43.738849 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Tenant-Id: 9614129d1e864c3ea288aaac8387c5d1 Jul 01 04:16:43.738849 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Tenant-Name: tempest-AttachVolumeTestJSON-416529265 Jul 01 04:16:43.738849 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-User: tempest-AttachVolumeTestJSON-416529265-project Jul 01 04:16:43.738849 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-User-Domain-Id: default Jul 01 04:16:43.738849 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-User-Domain-Name: Default Jul 01 04:16:43.738849 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-User-Id: 73d76a988462431fa6bb03dca64463a4 Jul 01 04:16:43.738849 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-User-Name: tempest-AttachVolumeTestJSON-416529265-project Jul 01 04:16:43.738849 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: method: > Jul 01 04:16:43.738849 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: exception: Instance 2e5d1edc-dbae-41dd-ab34-aa954b62f390 could not be found. Jul 01 04:16:43.738849 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: action_args: {'id': '2e5d1edc-dbae-41dd-ab34-aa954b62f390'} Jul 01 04:16:43.739841 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 04:16:43.739841 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 04:16:43.739841 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 04:16:43.739841 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 04:16:43.739841 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 04:16:43.739841 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 04:16:43.739841 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 04:16:43.739841 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 04:16:43.739841 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 04:16:43.739841 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 04:16:43.739841 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2e5d1edc-dbae-41dd-ab34-aa954b62f390 could not be found. Jul 01 04:16:43.739841 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi Jul 01 04:16:43.739841 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 04:16:43.739841 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi Jul 01 04:16:43.739841 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 04:16:43.739841 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 04:16:43.739841 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 04:16:43.739841 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 04:16:43.739841 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 04:16:43.739841 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 04:16:43.741391 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 04:16:43.741391 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 04:16:43.741391 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 04:16:43.741391 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 04:16:43.741391 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 04:16:43.741391 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 04:16:43.741391 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 04:16:43.741391 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2e5d1edc-dbae-41dd-ab34-aa954b62f390 could not be found. Jul 01 04:16:43.741391 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi Jul 01 04:16:43.741391 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 04:16:43.741391 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi Jul 01 04:16:43.741391 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 04:16:43.741391 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 04:16:43.741391 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 04:16:43.741391 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 04:16:43.741391 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 04:16:43.741391 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2e5d1edc-dbae-41dd-ab34-aa954b62f390 could not be found. Jul 01 04:16:43.741391 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi Jul 01 04:16:43.742754 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-cffc9182-11a4-40e3-8068-bf50ee45c08e tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] Returning 404 to user: Instance 2e5d1edc-dbae-41dd-ab34-aa954b62f390 could not be found. {{(pid=118712) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 04:16:43.742754 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-cffc9182-11a4-40e3-8068-bf50ee45c08e tempest-AttachVolumeTestJSON-416529265 tempest-AttachVolumeTestJSON-416529265-project] 10.222.0.20 "GET /compute/v2.1/servers/2e5d1edc-dbae-41dd-ab34-aa954b62f390" status: 404 len: 111 microversion: 2.1 time: 0.032103 Jul 01 04:16:43.742754 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 520/1029] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:16:43 2022] GET /compute/v2.1/servers/2e5d1edc-dbae-41dd-ab34-aa954b62f390 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 04:17:45.486015 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG dbcounter [-] [118711] Writing DB stats nova_api:SELECT=25 {{(pid=118711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:17:45.486819 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG dbcounter [-] [118711] Writing DB stats nova_cell1:SELECT=86,nova_cell1:INSERT=2 {{(pid=118711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:17:45.697536 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-f3e3a0d8-7e67-42b9-ac6e-fd3bf6cfbcc0 tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] Action: 'create', calling method: .version_select at 0x7f99a080c9d0>, body: {"keypair": {"name": "tempest-TestShelveInstance-2007925812", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGv8Lc8l25NIh9mN1gERaKZEyhDJbRMaZu3AQrH2MSdOFY0puZSfaUumkfwGvNb3E3WtQjYTH9UhlgA3WUh+AuMCZpafeofkkHBFRH8kfTRBn8LXn5455utRWK0WGCSqMQ=="}} {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 04:17:45.712952 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.quota [None req-f3e3a0d8-7e67-42b9-ac6e-fd3bf6cfbcc0 tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] Getting quotas for project c3d3ef4d370f432bb537d528fdd0e718. Resources: {'key_pairs'} {{(pid=118711) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 04:17:45.717823 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.quota [None req-f3e3a0d8-7e67-42b9-ac6e-fd3bf6cfbcc0 tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] Getting quotas for user 7e3e60783dd542dfbc3672c15c2807e4 and project c3d3ef4d370f432bb537d528fdd0e718. Resources: {'key_pairs'} {{(pid=118711) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 04:17:45.809526 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-f3e3a0d8-7e67-42b9-ac6e-fd3bf6cfbcc0 tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.325131 Jul 01 04:17:45.813435 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 510/1030] 10.222.0.20 () {60 vars in 1158 bytes} [Fri Jul 1 04:17:45 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 04:18:08.258089 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG dbcounter [-] [118712] Writing DB stats nova_api:SELECT=18,nova_api:DELETE=1 {{(pid=118712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:18:08.258774 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG dbcounter [-] [118712] Writing DB stats nova_cell1:SELECT=84,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=118712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:18:08.262724 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-42aa8b93-668e-4266-8d1b-94789b6c329c tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1133293687", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-2007925812", "security_groups": [{"name": "tempest-secgroup-smoke-787240459"}], "networks": [{"uuid": "14baabdb-7f31-45cf-9007-c57b9c9c4d89"}], "block_device_mapping_v2": [{"uuid": "dfa7a3bd-274c-49c7-a988-9eb419409e26", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 04:18:08.374254 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.network.neutron [None req-42aa8b93-668e-4266-8d1b-94789b6c329c tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] validate_networks() for [('14baabdb-7f31-45cf-9007-c57b9c9c4d89', None, None, None, None, None)] {{(pid=118712) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 01 04:18:08.749797 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.virt.hardware [None req-42aa8b93-668e-4266-8d1b-94789b6c329c tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] Flavor limits 0:0:0 {{(pid=118712) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 01 04:18:08.750311 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.virt.hardware [None req-42aa8b93-668e-4266-8d1b-94789b6c329c tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] Image limits 0:0:0 {{(pid=118712) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 01 04:18:08.750789 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.virt.hardware [None req-42aa8b93-668e-4266-8d1b-94789b6c329c tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] Flavor pref 0:0:0 {{(pid=118712) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 01 04:18:08.751207 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.virt.hardware [None req-42aa8b93-668e-4266-8d1b-94789b6c329c tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] Image pref 0:0:0 {{(pid=118712) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 01 04:18:08.751661 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.virt.hardware [None req-42aa8b93-668e-4266-8d1b-94789b6c329c tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118712) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 01 04:18:08.760672 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-42aa8b93-668e-4266-8d1b-94789b6c329c tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:18:08.761124 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-42aa8b93-668e-4266-8d1b-94789b6c329c tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:18:08.761944 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-42aa8b93-668e-4266-8d1b-94789b6c329c tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:18:08.762412 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-42aa8b93-668e-4266-8d1b-94789b6c329c tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:18:08.779283 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.quota [None req-42aa8b93-668e-4266-8d1b-94789b6c329c tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] Getting quotas for project c3d3ef4d370f432bb537d528fdd0e718. Resources: {'ram', 'cores', 'instances'} {{(pid=118712) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 04:18:08.783272 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.quota [None req-42aa8b93-668e-4266-8d1b-94789b6c329c tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] Getting quotas for user 7e3e60783dd542dfbc3672c15c2807e4 and project c3d3ef4d370f432bb537d528fdd0e718. Resources: {'ram', 'cores', 'instances'} {{(pid=118712) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 04:18:08.843996 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-42aa8b93-668e-4266-8d1b-94789b6c329c tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] Going to run 1 instances... {{(pid=118712) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 01 04:18:08.846328 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-42aa8b93-668e-4266-8d1b-94789b6c329c tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] [instance: 8dd47ea9-997d-42c3-9d5a-ff594c6623a1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='dfa7a3bd-274c-49c7-a988-9eb419409e26',volume_size=None,volume_type=None)] {{(pid=118712) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 01 04:18:09.256295 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-42aa8b93-668e-4266-8d1b-94789b6c329c tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.999997 Jul 01 04:18:09.256936 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 521/1031] 10.222.0.20 () {60 vars in 1146 bytes} [Fri Jul 1 04:18:08 2022] POST /compute/v2.1/servers => generated 405 bytes in 1001 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 01 04:18:09.265331 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG dbcounter [-] [118711] Writing DB stats nova_cell0:SELECT=4 {{(pid=118711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:18:09.266093 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG dbcounter [-] [118711] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=118711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:18:09.270066 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-8af13035-a74a-44b6-944d-c8b4a0dc70ac tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:18:09.270673 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-8af13035-a74a-44b6-944d-c8b4a0dc70ac tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] [instance: 8dd47ea9-997d-42c3-9d5a-ff594c6623a1] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:18:09.327654 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-8af13035-a74a-44b6-944d-c8b4a0dc70ac tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3e60783dd542dfbc3672c15c2807e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d3ef4d370f432bb537d528fdd0e718', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:18:09.334701 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-8af13035-a74a-44b6-944d-c8b4a0dc70ac tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] 10.222.0.20 "GET /compute/v2.1/servers/8dd47ea9-997d-42c3-9d5a-ff594c6623a1" status: 200 len: 1089 microversion: 2.1 time: 0.071627 Jul 01 04:18:09.335289 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 511/1032] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:18:09 2022] GET /compute/v2.1/servers/8dd47ea9-997d-42c3-9d5a-ff594c6623a1 => generated 1089 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:18:10.353767 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-471cee50-131f-42e7-a59b-e8f967866f14 tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:18:10.354393 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-471cee50-131f-42e7-a59b-e8f967866f14 tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] [instance: 8dd47ea9-997d-42c3-9d5a-ff594c6623a1] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:18:10.362874 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-471cee50-131f-42e7-a59b-e8f967866f14 tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:18:10.363068 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-471cee50-131f-42e7-a59b-e8f967866f14 tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:18:10.364130 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-471cee50-131f-42e7-a59b-e8f967866f14 tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:18:10.364898 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-471cee50-131f-42e7-a59b-e8f967866f14 tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:18:10.432457 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-471cee50-131f-42e7-a59b-e8f967866f14 tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3e60783dd542dfbc3672c15c2807e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d3ef4d370f432bb537d528fdd0e718', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:18:10.436292 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-471cee50-131f-42e7-a59b-e8f967866f14 tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] 10.222.0.20 "GET /compute/v2.1/servers/8dd47ea9-997d-42c3-9d5a-ff594c6623a1" status: 200 len: 1139 microversion: 2.1 time: 0.087117 Jul 01 04:18:10.437089 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 522/1033] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:18:10 2022] GET /compute/v2.1/servers/8dd47ea9-997d-42c3-9d5a-ff594c6623a1 => generated 1139 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:18:11.454540 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-35f8fb89-517f-4a9b-987e-33e3ccae538c tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:18:11.455137 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-35f8fb89-517f-4a9b-987e-33e3ccae538c tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] [instance: 8dd47ea9-997d-42c3-9d5a-ff594c6623a1] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:18:11.463254 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-35f8fb89-517f-4a9b-987e-33e3ccae538c tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:18:11.463711 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-35f8fb89-517f-4a9b-987e-33e3ccae538c tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:18:11.464491 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-35f8fb89-517f-4a9b-987e-33e3ccae538c tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:18:11.464946 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-35f8fb89-517f-4a9b-987e-33e3ccae538c tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:18:11.546536 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-35f8fb89-517f-4a9b-987e-33e3ccae538c tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3e60783dd542dfbc3672c15c2807e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d3ef4d370f432bb537d528fdd0e718', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:18:11.555123 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-35f8fb89-517f-4a9b-987e-33e3ccae538c tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] 10.222.0.20 "GET /compute/v2.1/servers/8dd47ea9-997d-42c3-9d5a-ff594c6623a1" status: 200 len: 1195 microversion: 2.1 time: 0.105176 Jul 01 04:18:11.556033 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 512/1034] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:18:11 2022] GET /compute/v2.1/servers/8dd47ea9-997d-42c3-9d5a-ff594c6623a1 => generated 1195 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:18:12.574088 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-741d3626-5803-4ad4-b836-a513f1adfcff tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:18:12.574716 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-741d3626-5803-4ad4-b836-a513f1adfcff tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] [instance: 8dd47ea9-997d-42c3-9d5a-ff594c6623a1] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:18:12.582289 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-741d3626-5803-4ad4-b836-a513f1adfcff tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:18:12.582747 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-741d3626-5803-4ad4-b836-a513f1adfcff tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:18:12.583623 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-741d3626-5803-4ad4-b836-a513f1adfcff tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:18:12.584073 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-741d3626-5803-4ad4-b836-a513f1adfcff tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:18:12.733228 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-741d3626-5803-4ad4-b836-a513f1adfcff tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3e60783dd542dfbc3672c15c2807e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d3ef4d370f432bb537d528fdd0e718', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:18:12.741929 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-741d3626-5803-4ad4-b836-a513f1adfcff tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] 10.222.0.20 "GET /compute/v2.1/servers/8dd47ea9-997d-42c3-9d5a-ff594c6623a1" status: 200 len: 1272 microversion: 2.1 time: 0.171695 Jul 01 04:18:12.743022 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 523/1035] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:18:12 2022] GET /compute/v2.1/servers/8dd47ea9-997d-42c3-9d5a-ff594c6623a1 => generated 1272 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:18:13.286492 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [req-05e0bc0d-900f-42d8-b318-32fcea6643af req-e14c0275-2905-48f3-a6ff-8614916f81e5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8dd47ea9-997d-42c3-9d5a-ff594c6623a1", "tag": "4551fc91-3567-411a-8170-956e8d791b33"}]} {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 04:18:13.298856 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [req-05e0bc0d-900f-42d8-b318-32fcea6643af req-e14c0275-2905-48f3-a6ff-8614916f81e5 service nova] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:18:13.299430 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [req-05e0bc0d-900f-42d8-b318-32fcea6643af req-e14c0275-2905-48f3-a6ff-8614916f81e5 service nova] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:18:13.330653 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.compute.server_external_events [req-05e0bc0d-900f-42d8-b318-32fcea6643af req-e14c0275-2905-48f3-a6ff-8614916f81e5 service nova] Creating event network-changed:4551fc91-3567-411a-8170-956e8d791b33 for instance 8dd47ea9-997d-42c3-9d5a-ff594c6623a1 on hv-cinder-84684 Jul 01 04:18:13.335796 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [req-05e0bc0d-900f-42d8-b318-32fcea6643af req-e14c0275-2905-48f3-a6ff-8614916f81e5 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053540 Jul 01 04:18:13.336527 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 513/1036] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Jul 1 04:18:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 04:18:13.761915 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-b200452b-35db-41d6-a85b-e498c24fa8da tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:18:13.762520 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-b200452b-35db-41d6-a85b-e498c24fa8da tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] [instance: 8dd47ea9-997d-42c3-9d5a-ff594c6623a1] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:18:13.769341 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-b200452b-35db-41d6-a85b-e498c24fa8da tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:18:13.769794 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-b200452b-35db-41d6-a85b-e498c24fa8da tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:18:13.772090 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-b200452b-35db-41d6-a85b-e498c24fa8da tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:18:13.772090 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-b200452b-35db-41d6-a85b-e498c24fa8da tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:18:13.906137 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-b200452b-35db-41d6-a85b-e498c24fa8da tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3e60783dd542dfbc3672c15c2807e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d3ef4d370f432bb537d528fdd0e718', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:18:13.914548 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-b200452b-35db-41d6-a85b-e498c24fa8da tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] 10.222.0.20 "GET /compute/v2.1/servers/8dd47ea9-997d-42c3-9d5a-ff594c6623a1" status: 200 len: 1260 microversion: 2.1 time: 0.156528 Jul 01 04:18:13.915134 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 524/1037] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:18:13 2022] GET /compute/v2.1/servers/8dd47ea9-997d-42c3-9d5a-ff594c6623a1 => generated 1260 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:18:14.932922 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-2e067d6f-f384-4afb-b3b0-4b5eb1f55ab0 tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:18:14.933514 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-2e067d6f-f384-4afb-b3b0-4b5eb1f55ab0 tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] [instance: 8dd47ea9-997d-42c3-9d5a-ff594c6623a1] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:18:14.939659 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-2e067d6f-f384-4afb-b3b0-4b5eb1f55ab0 tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:18:14.940106 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-2e067d6f-f384-4afb-b3b0-4b5eb1f55ab0 tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:18:14.940858 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-2e067d6f-f384-4afb-b3b0-4b5eb1f55ab0 tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:18:14.941287 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-2e067d6f-f384-4afb-b3b0-4b5eb1f55ab0 tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:18:15.078594 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-2e067d6f-f384-4afb-b3b0-4b5eb1f55ab0 tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3e60783dd542dfbc3672c15c2807e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d3ef4d370f432bb537d528fdd0e718', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:18:15.086433 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-2e067d6f-f384-4afb-b3b0-4b5eb1f55ab0 tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] 10.222.0.20 "GET /compute/v2.1/servers/8dd47ea9-997d-42c3-9d5a-ff594c6623a1" status: 200 len: 1260 microversion: 2.1 time: 0.158194 Jul 01 04:18:15.087005 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 514/1038] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:18:14 2022] GET /compute/v2.1/servers/8dd47ea9-997d-42c3-9d5a-ff594c6623a1 => generated 1260 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 04:18:16.103630 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-7d7d2ed3-c366-4c76-8cad-ec580b08b0ef tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:18:16.104267 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-7d7d2ed3-c366-4c76-8cad-ec580b08b0ef tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] [instance: 8dd47ea9-997d-42c3-9d5a-ff594c6623a1] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:18:16.111082 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-7d7d2ed3-c366-4c76-8cad-ec580b08b0ef tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:18:16.111558 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-7d7d2ed3-c366-4c76-8cad-ec580b08b0ef tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:18:16.112322 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-7d7d2ed3-c366-4c76-8cad-ec580b08b0ef tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:18:16.112758 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-7d7d2ed3-c366-4c76-8cad-ec580b08b0ef tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:18:16.249161 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-7d7d2ed3-c366-4c76-8cad-ec580b08b0ef tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3e60783dd542dfbc3672c15c2807e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d3ef4d370f432bb537d528fdd0e718', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:18:16.256869 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-7d7d2ed3-c366-4c76-8cad-ec580b08b0ef tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] 10.222.0.20 "GET /compute/v2.1/servers/8dd47ea9-997d-42c3-9d5a-ff594c6623a1" status: 200 len: 1260 microversion: 2.1 time: 0.157075 Jul 01 04:18:16.262197 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 525/1039] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:18:16 2022] GET /compute/v2.1/servers/8dd47ea9-997d-42c3-9d5a-ff594c6623a1 => generated 1260 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:18:17.273910 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-805f4bba-911f-4224-9c97-5acb060591c2 tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:18:17.274519 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-805f4bba-911f-4224-9c97-5acb060591c2 tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] [instance: 8dd47ea9-997d-42c3-9d5a-ff594c6623a1] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:18:17.281485 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-805f4bba-911f-4224-9c97-5acb060591c2 tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:18:17.281931 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-805f4bba-911f-4224-9c97-5acb060591c2 tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:18:17.282701 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-805f4bba-911f-4224-9c97-5acb060591c2 tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:18:17.283134 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-805f4bba-911f-4224-9c97-5acb060591c2 tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:18:17.417464 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-805f4bba-911f-4224-9c97-5acb060591c2 tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3e60783dd542dfbc3672c15c2807e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d3ef4d370f432bb537d528fdd0e718', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:18:17.425741 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-805f4bba-911f-4224-9c97-5acb060591c2 tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] 10.222.0.20 "GET /compute/v2.1/servers/8dd47ea9-997d-42c3-9d5a-ff594c6623a1" status: 200 len: 1260 microversion: 2.1 time: 0.155790 Jul 01 04:18:17.426308 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 515/1040] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:18:17 2022] GET /compute/v2.1/servers/8dd47ea9-997d-42c3-9d5a-ff594c6623a1 => generated 1260 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:18:18.442103 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-0b20e296-5c36-4588-b8ba-fbee1bea987e tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:18:18.442837 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-0b20e296-5c36-4588-b8ba-fbee1bea987e tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] [instance: 8dd47ea9-997d-42c3-9d5a-ff594c6623a1] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:18:18.449904 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-0b20e296-5c36-4588-b8ba-fbee1bea987e tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:18:18.450368 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-0b20e296-5c36-4588-b8ba-fbee1bea987e tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:18:18.451149 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-0b20e296-5c36-4588-b8ba-fbee1bea987e tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:18:18.452125 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-0b20e296-5c36-4588-b8ba-fbee1bea987e tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:18:18.594977 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-0b20e296-5c36-4588-b8ba-fbee1bea987e tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3e60783dd542dfbc3672c15c2807e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d3ef4d370f432bb537d528fdd0e718', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:18:18.599343 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-0b20e296-5c36-4588-b8ba-fbee1bea987e tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] 10.222.0.20 "GET /compute/v2.1/servers/8dd47ea9-997d-42c3-9d5a-ff594c6623a1" status: 200 len: 1260 microversion: 2.1 time: 0.161139 Jul 01 04:18:18.599906 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 526/1041] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:18:18 2022] GET /compute/v2.1/servers/8dd47ea9-997d-42c3-9d5a-ff594c6623a1 => generated 1260 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:18:19.616339 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-e46e2b12-1fcf-4b5f-be91-274d1aceb165 tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:18:19.616963 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-e46e2b12-1fcf-4b5f-be91-274d1aceb165 tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] [instance: 8dd47ea9-997d-42c3-9d5a-ff594c6623a1] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:18:19.623806 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-e46e2b12-1fcf-4b5f-be91-274d1aceb165 tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:18:19.624257 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-e46e2b12-1fcf-4b5f-be91-274d1aceb165 tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:18:19.625032 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-e46e2b12-1fcf-4b5f-be91-274d1aceb165 tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:18:19.625474 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-e46e2b12-1fcf-4b5f-be91-274d1aceb165 tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:18:19.762662 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-e46e2b12-1fcf-4b5f-be91-274d1aceb165 tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3e60783dd542dfbc3672c15c2807e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d3ef4d370f432bb537d528fdd0e718', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:18:19.770948 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-e46e2b12-1fcf-4b5f-be91-274d1aceb165 tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] 10.222.0.20 "GET /compute/v2.1/servers/8dd47ea9-997d-42c3-9d5a-ff594c6623a1" status: 200 len: 1260 microversion: 2.1 time: 0.158655 Jul 01 04:18:19.771958 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 516/1042] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:18:19 2022] GET /compute/v2.1/servers/8dd47ea9-997d-42c3-9d5a-ff594c6623a1 => generated 1260 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:18:20.788362 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-e949464a-1e56-4200-b34e-bf9faa5f03f8 tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:18:20.788999 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-e949464a-1e56-4200-b34e-bf9faa5f03f8 tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] [instance: 8dd47ea9-997d-42c3-9d5a-ff594c6623a1] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:18:20.790800 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG dbcounter [-] [118712] Writing DB stats nova_cell0:SELECT=2 {{(pid=118712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:18:20.791638 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG dbcounter [-] [118712] Writing DB stats nova_cell0:SELECT=6 {{(pid=118712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:18:20.797384 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-e949464a-1e56-4200-b34e-bf9faa5f03f8 tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:18:20.797865 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-e949464a-1e56-4200-b34e-bf9faa5f03f8 tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:18:20.798625 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-e949464a-1e56-4200-b34e-bf9faa5f03f8 tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:18:20.799057 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-e949464a-1e56-4200-b34e-bf9faa5f03f8 tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:18:20.935058 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-e949464a-1e56-4200-b34e-bf9faa5f03f8 tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3e60783dd542dfbc3672c15c2807e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d3ef4d370f432bb537d528fdd0e718', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:18:20.943024 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-e949464a-1e56-4200-b34e-bf9faa5f03f8 tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] 10.222.0.20 "GET /compute/v2.1/servers/8dd47ea9-997d-42c3-9d5a-ff594c6623a1" status: 200 len: 1260 microversion: 2.1 time: 0.158520 Jul 01 04:18:20.943640 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 527/1043] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:18:20 2022] GET /compute/v2.1/servers/8dd47ea9-997d-42c3-9d5a-ff594c6623a1 => generated 1260 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 04:18:21.960434 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-8ec0c997-6f62-4eb4-9596-d9af84a2a354 tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:18:21.960969 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-8ec0c997-6f62-4eb4-9596-d9af84a2a354 tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] [instance: 8dd47ea9-997d-42c3-9d5a-ff594c6623a1] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:18:21.963409 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG dbcounter [-] [118711] Writing DB stats nova_cell0:SELECT=2 {{(pid=118711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:18:21.968209 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-8ec0c997-6f62-4eb4-9596-d9af84a2a354 tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:18:21.968659 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-8ec0c997-6f62-4eb4-9596-d9af84a2a354 tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:18:21.969429 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-8ec0c997-6f62-4eb4-9596-d9af84a2a354 tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:18:21.969867 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-8ec0c997-6f62-4eb4-9596-d9af84a2a354 tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:18:22.117129 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-8ec0c997-6f62-4eb4-9596-d9af84a2a354 tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3e60783dd542dfbc3672c15c2807e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d3ef4d370f432bb537d528fdd0e718', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:18:22.127483 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-8ec0c997-6f62-4eb4-9596-d9af84a2a354 tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] 10.222.0.20 "GET /compute/v2.1/servers/8dd47ea9-997d-42c3-9d5a-ff594c6623a1" status: 200 len: 1260 microversion: 2.1 time: 0.170963 Jul 01 04:18:22.128124 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 517/1044] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:18:21 2022] GET /compute/v2.1/servers/8dd47ea9-997d-42c3-9d5a-ff594c6623a1 => generated 1260 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:18:23.169059 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-fca1c5ab-2d7e-4dae-8959-b2b7bc5b6130 tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:18:23.169676 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-fca1c5ab-2d7e-4dae-8959-b2b7bc5b6130 tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] [instance: 8dd47ea9-997d-42c3-9d5a-ff594c6623a1] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:18:23.176231 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-fca1c5ab-2d7e-4dae-8959-b2b7bc5b6130 tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:18:23.176678 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-fca1c5ab-2d7e-4dae-8959-b2b7bc5b6130 tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:18:23.177435 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-fca1c5ab-2d7e-4dae-8959-b2b7bc5b6130 tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:18:23.177872 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-fca1c5ab-2d7e-4dae-8959-b2b7bc5b6130 tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:18:23.308018 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-fca1c5ab-2d7e-4dae-8959-b2b7bc5b6130 tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3e60783dd542dfbc3672c15c2807e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d3ef4d370f432bb537d528fdd0e718', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:18:23.316080 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-fca1c5ab-2d7e-4dae-8959-b2b7bc5b6130 tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] 10.222.0.20 "GET /compute/v2.1/servers/8dd47ea9-997d-42c3-9d5a-ff594c6623a1" status: 200 len: 1260 microversion: 2.1 time: 0.151008 Jul 01 04:18:23.316661 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 528/1045] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:18:23 2022] GET /compute/v2.1/servers/8dd47ea9-997d-42c3-9d5a-ff594c6623a1 => generated 1260 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:18:23.596414 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [req-3509b13c-7434-423f-8841-cddb1f5b2bfb req-ff6b68cf-d248-4ebb-a610-cf56efeee383 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8dd47ea9-997d-42c3-9d5a-ff594c6623a1", "name": "network-vif-plugged", "status": "completed", "tag": "4551fc91-3567-411a-8170-956e8d791b33"}]} {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 04:18:23.605300 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [req-3509b13c-7434-423f-8841-cddb1f5b2bfb req-ff6b68cf-d248-4ebb-a610-cf56efeee383 service nova] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:18:23.607978 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [req-3509b13c-7434-423f-8841-cddb1f5b2bfb req-ff6b68cf-d248-4ebb-a610-cf56efeee383 service nova] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:18:23.617673 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.compute.server_external_events [req-3509b13c-7434-423f-8841-cddb1f5b2bfb req-ff6b68cf-d248-4ebb-a610-cf56efeee383 service nova] Creating event network-vif-plugged:4551fc91-3567-411a-8170-956e8d791b33 for instance 8dd47ea9-997d-42c3-9d5a-ff594c6623a1 on hv-cinder-84684 Jul 01 04:18:23.622898 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [req-3509b13c-7434-423f-8841-cddb1f5b2bfb req-ff6b68cf-d248-4ebb-a610-cf56efeee383 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030209 Jul 01 04:18:23.623555 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 518/1046] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Jul 1 04:18:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 04:18:24.333523 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-60e550f5-51f9-42d2-a1fe-ecea574f491d tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:18:24.334156 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-60e550f5-51f9-42d2-a1fe-ecea574f491d tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] [instance: 8dd47ea9-997d-42c3-9d5a-ff594c6623a1] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:18:24.340726 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-60e550f5-51f9-42d2-a1fe-ecea574f491d tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:18:24.342561 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-60e550f5-51f9-42d2-a1fe-ecea574f491d tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:18:24.342561 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-60e550f5-51f9-42d2-a1fe-ecea574f491d tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:18:24.342561 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-60e550f5-51f9-42d2-a1fe-ecea574f491d tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:18:24.483587 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-60e550f5-51f9-42d2-a1fe-ecea574f491d tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3e60783dd542dfbc3672c15c2807e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d3ef4d370f432bb537d528fdd0e718', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:18:24.491187 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-60e550f5-51f9-42d2-a1fe-ecea574f491d tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] 10.222.0.20 "GET /compute/v2.1/servers/8dd47ea9-997d-42c3-9d5a-ff594c6623a1" status: 200 len: 1260 microversion: 2.1 time: 0.161506 Jul 01 04:18:24.491786 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 529/1047] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:18:24 2022] GET /compute/v2.1/servers/8dd47ea9-997d-42c3-9d5a-ff594c6623a1 => generated 1260 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:18:25.520006 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-58aa747d-01db-4805-a7cb-b1e6f5bcca60 tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:18:25.520733 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-58aa747d-01db-4805-a7cb-b1e6f5bcca60 tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] [instance: 8dd47ea9-997d-42c3-9d5a-ff594c6623a1] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:18:25.527118 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-58aa747d-01db-4805-a7cb-b1e6f5bcca60 tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:18:25.527609 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-58aa747d-01db-4805-a7cb-b1e6f5bcca60 tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:18:25.528382 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-58aa747d-01db-4805-a7cb-b1e6f5bcca60 tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:18:25.528826 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-58aa747d-01db-4805-a7cb-b1e6f5bcca60 tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:18:25.661651 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-58aa747d-01db-4805-a7cb-b1e6f5bcca60 tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3e60783dd542dfbc3672c15c2807e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d3ef4d370f432bb537d528fdd0e718', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:18:25.669154 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-58aa747d-01db-4805-a7cb-b1e6f5bcca60 tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] 10.222.0.20 "GET /compute/v2.1/servers/8dd47ea9-997d-42c3-9d5a-ff594c6623a1" status: 200 len: 1443 microversion: 2.1 time: 0.154656 Jul 01 04:18:25.669717 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 519/1048] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:18:25 2022] GET /compute/v2.1/servers/8dd47ea9-997d-42c3-9d5a-ff594c6623a1 => generated 1443 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:18:25.685639 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-db39e167-43ca-4a92-8438-ac859f8dbe1a tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:18:25.686262 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-db39e167-43ca-4a92-8438-ac859f8dbe1a tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] [instance: 8dd47ea9-997d-42c3-9d5a-ff594c6623a1] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:18:25.693387 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-db39e167-43ca-4a92-8438-ac859f8dbe1a tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:18:25.693846 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-db39e167-43ca-4a92-8438-ac859f8dbe1a tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:18:25.694878 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-db39e167-43ca-4a92-8438-ac859f8dbe1a tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:18:25.695349 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-db39e167-43ca-4a92-8438-ac859f8dbe1a tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:18:25.824411 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-db39e167-43ca-4a92-8438-ac859f8dbe1a tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3e60783dd542dfbc3672c15c2807e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d3ef4d370f432bb537d528fdd0e718', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:18:25.832012 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-db39e167-43ca-4a92-8438-ac859f8dbe1a tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] 10.222.0.20 "GET /compute/v2.1/servers/8dd47ea9-997d-42c3-9d5a-ff594c6623a1" status: 200 len: 1443 microversion: 2.1 time: 0.150262 Jul 01 04:18:25.832598 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 530/1049] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:18:25 2022] GET /compute/v2.1/servers/8dd47ea9-997d-42c3-9d5a-ff594c6623a1 => generated 1443 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:18:27.857787 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [req-d7d20885-4df9-4a5e-b3bd-bfddcfa09203 req-a5301ab0-cf5d-48c3-ba6b-8e1ee9fda40f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8dd47ea9-997d-42c3-9d5a-ff594c6623a1", "tag": "4551fc91-3567-411a-8170-956e8d791b33"}]} {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 04:18:27.866919 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [req-d7d20885-4df9-4a5e-b3bd-bfddcfa09203 req-a5301ab0-cf5d-48c3-ba6b-8e1ee9fda40f service nova] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:18:27.867394 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [req-d7d20885-4df9-4a5e-b3bd-bfddcfa09203 req-a5301ab0-cf5d-48c3-ba6b-8e1ee9fda40f service nova] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:18:27.879709 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.compute.server_external_events [req-d7d20885-4df9-4a5e-b3bd-bfddcfa09203 req-a5301ab0-cf5d-48c3-ba6b-8e1ee9fda40f service nova] Creating event network-changed:4551fc91-3567-411a-8170-956e8d791b33 for instance 8dd47ea9-997d-42c3-9d5a-ff594c6623a1 on hv-cinder-84684 Jul 01 04:18:27.884962 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [req-d7d20885-4df9-4a5e-b3bd-bfddcfa09203 req-a5301ab0-cf5d-48c3-ba6b-8e1ee9fda40f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031048 Jul 01 04:18:27.885585 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 520/1050] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Jul 1 04:18:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 04:19:39.889159 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 01 04:19:39.889782 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: Fri Jul 1 04:19:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 01 04:19:46.130420 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 01 04:19:46.131539 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: Fri Jul 1 04:19:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 01 04:20:23.158408 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG dbcounter [-] [118712] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=118712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:20:23.159298 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG dbcounter [-] [118712] Writing DB stats nova_cell1:SELECT=56 {{(pid=118712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:20:23.163348 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-dce5bd73-e27c-47c4-85a7-2220a653a56e tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 04:20:23.163909 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-dce5bd73-e27c-47c4-85a7-2220a653a56e tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] [instance: 8dd47ea9-997d-42c3-9d5a-ff594c6623a1] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:20:23.169796 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-dce5bd73-e27c-47c4-85a7-2220a653a56e tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:20:23.170419 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-dce5bd73-e27c-47c4-85a7-2220a653a56e tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:20:23.171190 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-dce5bd73-e27c-47c4-85a7-2220a653a56e tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:20:23.171655 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-dce5bd73-e27c-47c4-85a7-2220a653a56e tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:20:23.197556 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.objects.instance [None req-dce5bd73-e27c-47c4-85a7-2220a653a56e tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] Lazy-loading 'flavor' on Instance uuid 8dd47ea9-997d-42c3-9d5a-ff594c6623a1 {{(pid=118712) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 04:20:23.454422 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-dce5bd73-e27c-47c4-85a7-2220a653a56e tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] 10.222.0.20 "POST /compute/v2.1/servers/8dd47ea9-997d-42c3-9d5a-ff594c6623a1/action" status: 202 len: 0 microversion: 2.1 time: 0.297421 Jul 01 04:20:23.454926 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 531/1051] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Jul 1 04:20:23 2022] POST /compute/v2.1/servers/8dd47ea9-997d-42c3-9d5a-ff594c6623a1/action => generated 0 bytes in 299 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 04:20:23.462400 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG dbcounter [-] [118711] Writing DB stats nova_api:SELECT=22 {{(pid=118711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:20:23.463528 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG dbcounter [-] [118711] Writing DB stats nova_cell1:SELECT=42 {{(pid=118711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:20:23.467708 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-dfab8212-ecec-464c-9b8c-1cff3b08c60e tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:20:23.468421 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-dfab8212-ecec-464c-9b8c-1cff3b08c60e tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] [instance: 8dd47ea9-997d-42c3-9d5a-ff594c6623a1] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:20:23.475819 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-dfab8212-ecec-464c-9b8c-1cff3b08c60e tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:20:23.476268 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-dfab8212-ecec-464c-9b8c-1cff3b08c60e tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:20:23.477043 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-dfab8212-ecec-464c-9b8c-1cff3b08c60e tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:20:23.477483 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-dfab8212-ecec-464c-9b8c-1cff3b08c60e tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:20:23.731566 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-dfab8212-ecec-464c-9b8c-1cff3b08c60e tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3e60783dd542dfbc3672c15c2807e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d3ef4d370f432bb537d528fdd0e718', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:20:23.739017 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-dfab8212-ecec-464c-9b8c-1cff3b08c60e tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] 10.222.0.20 "GET /compute/v2.1/servers/8dd47ea9-997d-42c3-9d5a-ff594c6623a1" status: 200 len: 1568 microversion: 2.1 time: 0.278738 Jul 01 04:20:23.739824 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 521/1052] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:20:23 2022] GET /compute/v2.1/servers/8dd47ea9-997d-42c3-9d5a-ff594c6623a1 => generated 1568 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:20:24.756624 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-070516ba-e534-4137-93d8-26382c98d986 tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:20:24.757339 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-070516ba-e534-4137-93d8-26382c98d986 tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] [instance: 8dd47ea9-997d-42c3-9d5a-ff594c6623a1] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:20:24.763539 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-070516ba-e534-4137-93d8-26382c98d986 tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:20:24.764001 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-070516ba-e534-4137-93d8-26382c98d986 tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:20:24.764773 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-070516ba-e534-4137-93d8-26382c98d986 tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:20:24.765218 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-070516ba-e534-4137-93d8-26382c98d986 tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:20:24.972611 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-070516ba-e534-4137-93d8-26382c98d986 tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3e60783dd542dfbc3672c15c2807e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d3ef4d370f432bb537d528fdd0e718', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:20:24.972611 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-070516ba-e534-4137-93d8-26382c98d986 tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] 10.222.0.20 "GET /compute/v2.1/servers/8dd47ea9-997d-42c3-9d5a-ff594c6623a1" status: 200 len: 1568 microversion: 2.1 time: 0.219971 Jul 01 04:20:24.973077 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 532/1053] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:20:24 2022] GET /compute/v2.1/servers/8dd47ea9-997d-42c3-9d5a-ff594c6623a1 => generated 1568 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:20:25.995923 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-dbc0ff47-efcf-4305-a864-089c610b7ee7 tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:20:25.996481 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-dbc0ff47-efcf-4305-a864-089c610b7ee7 tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] [instance: 8dd47ea9-997d-42c3-9d5a-ff594c6623a1] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:20:26.002949 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-dbc0ff47-efcf-4305-a864-089c610b7ee7 tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:20:26.003434 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-dbc0ff47-efcf-4305-a864-089c610b7ee7 tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:20:26.004193 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-dbc0ff47-efcf-4305-a864-089c610b7ee7 tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:20:26.004625 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-dbc0ff47-efcf-4305-a864-089c610b7ee7 tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:20:26.142222 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-dbc0ff47-efcf-4305-a864-089c610b7ee7 tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3e60783dd542dfbc3672c15c2807e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d3ef4d370f432bb537d528fdd0e718', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:20:26.149812 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-dbc0ff47-efcf-4305-a864-089c610b7ee7 tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] 10.222.0.20 "GET /compute/v2.1/servers/8dd47ea9-997d-42c3-9d5a-ff594c6623a1" status: 200 len: 1568 microversion: 2.1 time: 0.157825 Jul 01 04:20:26.150375 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 522/1054] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:20:25 2022] GET /compute/v2.1/servers/8dd47ea9-997d-42c3-9d5a-ff594c6623a1 => generated 1568 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:20:27.167557 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-8b667640-c78e-4a4f-a4ec-9023ec0d4e5d tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:20:27.168156 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-8b667640-c78e-4a4f-a4ec-9023ec0d4e5d tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] [instance: 8dd47ea9-997d-42c3-9d5a-ff594c6623a1] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:20:27.175303 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-8b667640-c78e-4a4f-a4ec-9023ec0d4e5d tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:20:27.182047 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-8b667640-c78e-4a4f-a4ec-9023ec0d4e5d tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:20:27.182047 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-8b667640-c78e-4a4f-a4ec-9023ec0d4e5d tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:20:27.182047 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-8b667640-c78e-4a4f-a4ec-9023ec0d4e5d tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:20:27.312453 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-8b667640-c78e-4a4f-a4ec-9023ec0d4e5d tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3e60783dd542dfbc3672c15c2807e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d3ef4d370f432bb537d528fdd0e718', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:20:27.321345 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-8b667640-c78e-4a4f-a4ec-9023ec0d4e5d tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] 10.222.0.20 "GET /compute/v2.1/servers/8dd47ea9-997d-42c3-9d5a-ff594c6623a1" status: 200 len: 1568 microversion: 2.1 time: 0.157743 Jul 01 04:20:27.321929 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 533/1055] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:20:27 2022] GET /compute/v2.1/servers/8dd47ea9-997d-42c3-9d5a-ff594c6623a1 => generated 1568 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:20:28.338588 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-315492c3-aa61-46ab-8329-9aec48d49d0e tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:20:28.339147 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-315492c3-aa61-46ab-8329-9aec48d49d0e tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] [instance: 8dd47ea9-997d-42c3-9d5a-ff594c6623a1] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:20:28.346083 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-315492c3-aa61-46ab-8329-9aec48d49d0e tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:20:28.346543 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-315492c3-aa61-46ab-8329-9aec48d49d0e tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:20:28.347372 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-315492c3-aa61-46ab-8329-9aec48d49d0e tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:20:28.347833 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-315492c3-aa61-46ab-8329-9aec48d49d0e tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:20:28.483025 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-315492c3-aa61-46ab-8329-9aec48d49d0e tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3e60783dd542dfbc3672c15c2807e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d3ef4d370f432bb537d528fdd0e718', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:20:28.491249 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-315492c3-aa61-46ab-8329-9aec48d49d0e tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] 10.222.0.20 "GET /compute/v2.1/servers/8dd47ea9-997d-42c3-9d5a-ff594c6623a1" status: 200 len: 1568 microversion: 2.1 time: 0.156695 Jul 01 04:20:28.491811 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 523/1056] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:20:28 2022] GET /compute/v2.1/servers/8dd47ea9-997d-42c3-9d5a-ff594c6623a1 => generated 1568 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:20:29.508532 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-f617865f-2c72-4637-8774-92f919d583d0 tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:20:29.509140 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-f617865f-2c72-4637-8774-92f919d583d0 tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] [instance: 8dd47ea9-997d-42c3-9d5a-ff594c6623a1] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:20:29.515699 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-f617865f-2c72-4637-8774-92f919d583d0 tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:20:29.516161 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-f617865f-2c72-4637-8774-92f919d583d0 tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:20:29.516942 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-f617865f-2c72-4637-8774-92f919d583d0 tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:20:29.517385 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-f617865f-2c72-4637-8774-92f919d583d0 tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:20:29.651848 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-f617865f-2c72-4637-8774-92f919d583d0 tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3e60783dd542dfbc3672c15c2807e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d3ef4d370f432bb537d528fdd0e718', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:20:29.659426 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-f617865f-2c72-4637-8774-92f919d583d0 tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] 10.222.0.20 "GET /compute/v2.1/servers/8dd47ea9-997d-42c3-9d5a-ff594c6623a1" status: 200 len: 1568 microversion: 2.1 time: 0.154854 Jul 01 04:20:29.660002 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 534/1057] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:20:29 2022] GET /compute/v2.1/servers/8dd47ea9-997d-42c3-9d5a-ff594c6623a1 => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:20:30.677080 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-706b43ef-e851-4430-9652-b2cb9a187bd8 tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:20:30.677637 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-706b43ef-e851-4430-9652-b2cb9a187bd8 tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] [instance: 8dd47ea9-997d-42c3-9d5a-ff594c6623a1] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:20:30.684027 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-706b43ef-e851-4430-9652-b2cb9a187bd8 tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:20:30.684469 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-706b43ef-e851-4430-9652-b2cb9a187bd8 tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:20:30.685222 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-706b43ef-e851-4430-9652-b2cb9a187bd8 tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:20:30.685651 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-706b43ef-e851-4430-9652-b2cb9a187bd8 tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:20:30.816028 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-706b43ef-e851-4430-9652-b2cb9a187bd8 tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3e60783dd542dfbc3672c15c2807e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d3ef4d370f432bb537d528fdd0e718', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:20:30.824065 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-706b43ef-e851-4430-9652-b2cb9a187bd8 tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] 10.222.0.20 "GET /compute/v2.1/servers/8dd47ea9-997d-42c3-9d5a-ff594c6623a1" status: 200 len: 1568 microversion: 2.1 time: 0.151550 Jul 01 04:20:30.824632 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 524/1058] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:20:30 2022] GET /compute/v2.1/servers/8dd47ea9-997d-42c3-9d5a-ff594c6623a1 => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 04:20:31.842275 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-df3b4058-faf9-48fd-9736-012b0f174306 tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:20:31.842828 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-df3b4058-faf9-48fd-9736-012b0f174306 tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] [instance: 8dd47ea9-997d-42c3-9d5a-ff594c6623a1] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:20:31.850169 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-df3b4058-faf9-48fd-9736-012b0f174306 tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:20:31.850630 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-df3b4058-faf9-48fd-9736-012b0f174306 tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:20:31.851454 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-df3b4058-faf9-48fd-9736-012b0f174306 tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:20:31.851903 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-df3b4058-faf9-48fd-9736-012b0f174306 tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:20:31.986145 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-df3b4058-faf9-48fd-9736-012b0f174306 tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3e60783dd542dfbc3672c15c2807e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d3ef4d370f432bb537d528fdd0e718', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:20:31.994247 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-df3b4058-faf9-48fd-9736-012b0f174306 tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] 10.222.0.20 "GET /compute/v2.1/servers/8dd47ea9-997d-42c3-9d5a-ff594c6623a1" status: 200 len: 1568 microversion: 2.1 time: 0.156053 Jul 01 04:20:31.994824 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 535/1059] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:20:31 2022] GET /compute/v2.1/servers/8dd47ea9-997d-42c3-9d5a-ff594c6623a1 => generated 1568 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:20:33.011323 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-3414006a-deb4-4cb0-ac53-2c891b880ee1 tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:20:33.011939 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-3414006a-deb4-4cb0-ac53-2c891b880ee1 tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] [instance: 8dd47ea9-997d-42c3-9d5a-ff594c6623a1] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:20:33.018218 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-3414006a-deb4-4cb0-ac53-2c891b880ee1 tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:20:33.018673 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-3414006a-deb4-4cb0-ac53-2c891b880ee1 tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:20:33.019465 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-3414006a-deb4-4cb0-ac53-2c891b880ee1 tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:20:33.019907 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-3414006a-deb4-4cb0-ac53-2c891b880ee1 tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:20:33.152401 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-3414006a-deb4-4cb0-ac53-2c891b880ee1 tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3e60783dd542dfbc3672c15c2807e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d3ef4d370f432bb537d528fdd0e718', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:20:33.160349 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-3414006a-deb4-4cb0-ac53-2c891b880ee1 tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] 10.222.0.20 "GET /compute/v2.1/servers/8dd47ea9-997d-42c3-9d5a-ff594c6623a1" status: 200 len: 1568 microversion: 2.1 time: 0.152870 Jul 01 04:20:33.160915 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 525/1060] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:20:33 2022] GET /compute/v2.1/servers/8dd47ea9-997d-42c3-9d5a-ff594c6623a1 => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:20:34.177892 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-f584d3ef-4343-4245-96b2-5af9a69e0df0 tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:20:34.178489 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-f584d3ef-4343-4245-96b2-5af9a69e0df0 tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] [instance: 8dd47ea9-997d-42c3-9d5a-ff594c6623a1] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:20:34.185008 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-f584d3ef-4343-4245-96b2-5af9a69e0df0 tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:20:34.185456 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-f584d3ef-4343-4245-96b2-5af9a69e0df0 tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:20:34.186250 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-f584d3ef-4343-4245-96b2-5af9a69e0df0 tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:20:34.186683 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-f584d3ef-4343-4245-96b2-5af9a69e0df0 tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:20:34.327167 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-f584d3ef-4343-4245-96b2-5af9a69e0df0 tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3e60783dd542dfbc3672c15c2807e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d3ef4d370f432bb537d528fdd0e718', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:20:34.335520 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-f584d3ef-4343-4245-96b2-5af9a69e0df0 tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] 10.222.0.20 "GET /compute/v2.1/servers/8dd47ea9-997d-42c3-9d5a-ff594c6623a1" status: 200 len: 1568 microversion: 2.1 time: 0.161780 Jul 01 04:20:34.336115 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 536/1061] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:20:34 2022] GET /compute/v2.1/servers/8dd47ea9-997d-42c3-9d5a-ff594c6623a1 => generated 1568 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:20:35.353496 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-f072c5ba-9b7b-4d34-a299-61e4456655b4 tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:20:35.361928 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-f072c5ba-9b7b-4d34-a299-61e4456655b4 tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] [instance: 8dd47ea9-997d-42c3-9d5a-ff594c6623a1] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:20:35.361928 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-f072c5ba-9b7b-4d34-a299-61e4456655b4 tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:20:35.361928 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-f072c5ba-9b7b-4d34-a299-61e4456655b4 tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:20:35.362251 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-f072c5ba-9b7b-4d34-a299-61e4456655b4 tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:20:35.362624 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-f072c5ba-9b7b-4d34-a299-61e4456655b4 tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:20:35.495001 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-f072c5ba-9b7b-4d34-a299-61e4456655b4 tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3e60783dd542dfbc3672c15c2807e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d3ef4d370f432bb537d528fdd0e718', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:20:35.502670 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-f072c5ba-9b7b-4d34-a299-61e4456655b4 tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] 10.222.0.20 "GET /compute/v2.1/servers/8dd47ea9-997d-42c3-9d5a-ff594c6623a1" status: 200 len: 1568 microversion: 2.1 time: 0.153308 Jul 01 04:20:35.503243 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 526/1062] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:20:35 2022] GET /compute/v2.1/servers/8dd47ea9-997d-42c3-9d5a-ff594c6623a1 => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:20:36.519656 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-29eda933-8036-428a-9fa2-307fe6376fb2 tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:20:36.520278 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-29eda933-8036-428a-9fa2-307fe6376fb2 tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] [instance: 8dd47ea9-997d-42c3-9d5a-ff594c6623a1] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:20:36.526838 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-29eda933-8036-428a-9fa2-307fe6376fb2 tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:20:36.527300 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-29eda933-8036-428a-9fa2-307fe6376fb2 tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:20:36.528066 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-29eda933-8036-428a-9fa2-307fe6376fb2 tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:20:36.528504 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-29eda933-8036-428a-9fa2-307fe6376fb2 tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:20:36.665276 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-29eda933-8036-428a-9fa2-307fe6376fb2 tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3e60783dd542dfbc3672c15c2807e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d3ef4d370f432bb537d528fdd0e718', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:20:36.672998 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-29eda933-8036-428a-9fa2-307fe6376fb2 tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] 10.222.0.20 "GET /compute/v2.1/servers/8dd47ea9-997d-42c3-9d5a-ff594c6623a1" status: 200 len: 1568 microversion: 2.1 time: 0.157197 Jul 01 04:20:36.673508 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 537/1063] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:20:36 2022] GET /compute/v2.1/servers/8dd47ea9-997d-42c3-9d5a-ff594c6623a1 => generated 1568 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:20:37.689964 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-027658b7-c877-4c67-ac55-e74a795a617d tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:20:37.690609 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-027658b7-c877-4c67-ac55-e74a795a617d tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] [instance: 8dd47ea9-997d-42c3-9d5a-ff594c6623a1] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:20:37.698084 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-027658b7-c877-4c67-ac55-e74a795a617d tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:20:37.698531 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-027658b7-c877-4c67-ac55-e74a795a617d tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:20:37.699331 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-027658b7-c877-4c67-ac55-e74a795a617d tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:20:37.699770 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-027658b7-c877-4c67-ac55-e74a795a617d tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:20:37.835858 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-027658b7-c877-4c67-ac55-e74a795a617d tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3e60783dd542dfbc3672c15c2807e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d3ef4d370f432bb537d528fdd0e718', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:20:37.844088 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-027658b7-c877-4c67-ac55-e74a795a617d tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] 10.222.0.20 "GET /compute/v2.1/servers/8dd47ea9-997d-42c3-9d5a-ff594c6623a1" status: 200 len: 1509 microversion: 2.1 time: 0.158000 Jul 01 04:20:37.844651 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 527/1064] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:20:37 2022] GET /compute/v2.1/servers/8dd47ea9-997d-42c3-9d5a-ff594c6623a1 => generated 1509 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:20:37.862121 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-42de4bcb-2c16-4f2b-920e-511a0c1d8833 tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 04:20:37.863371 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-42de4bcb-2c16-4f2b-920e-511a0c1d8833 tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] [instance: 8dd47ea9-997d-42c3-9d5a-ff594c6623a1] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:20:37.870372 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-42de4bcb-2c16-4f2b-920e-511a0c1d8833 tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:20:37.870816 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-42de4bcb-2c16-4f2b-920e-511a0c1d8833 tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:20:37.871727 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-42de4bcb-2c16-4f2b-920e-511a0c1d8833 tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:20:37.872164 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-42de4bcb-2c16-4f2b-920e-511a0c1d8833 tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:20:38.081295 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-42de4bcb-2c16-4f2b-920e-511a0c1d8833 tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] 10.222.0.20 "POST /compute/v2.1/servers/8dd47ea9-997d-42c3-9d5a-ff594c6623a1/action" status: 202 len: 0 microversion: 2.1 time: 0.223360 Jul 01 04:20:38.081947 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 538/1065] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Jul 1 04:20:37 2022] POST /compute/v2.1/servers/8dd47ea9-997d-42c3-9d5a-ff594c6623a1/action => generated 0 bytes in 225 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 04:20:38.090011 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-178ba969-b0cb-4b6c-a991-4ed35cd991ae tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:20:38.090637 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-178ba969-b0cb-4b6c-a991-4ed35cd991ae tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] [instance: 8dd47ea9-997d-42c3-9d5a-ff594c6623a1] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:20:38.096815 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-178ba969-b0cb-4b6c-a991-4ed35cd991ae tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:20:38.097792 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-178ba969-b0cb-4b6c-a991-4ed35cd991ae tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:20:38.098954 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-178ba969-b0cb-4b6c-a991-4ed35cd991ae tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:20:38.099089 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-178ba969-b0cb-4b6c-a991-4ed35cd991ae tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:20:38.214431 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [req-b00413b3-feea-49f9-ab7e-294f552ceae6 req-9567c986-2d85-4a49-ace4-45e0c752ca44 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8dd47ea9-997d-42c3-9d5a-ff594c6623a1", "name": "network-vif-unplugged", "status": "completed", "tag": "4551fc91-3567-411a-8170-956e8d791b33"}]} {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 04:20:38.234988 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [req-b00413b3-feea-49f9-ab7e-294f552ceae6 req-9567c986-2d85-4a49-ace4-45e0c752ca44 service nova] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:20:38.235567 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [req-b00413b3-feea-49f9-ab7e-294f552ceae6 req-9567c986-2d85-4a49-ace4-45e0c752ca44 service nova] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:20:38.241550 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-178ba969-b0cb-4b6c-a991-4ed35cd991ae tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3e60783dd542dfbc3672c15c2807e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d3ef4d370f432bb537d528fdd0e718', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:20:38.248030 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.compute.server_external_events [req-b00413b3-feea-49f9-ab7e-294f552ceae6 req-9567c986-2d85-4a49-ace4-45e0c752ca44 service nova] Unable to find a host for instance 8dd47ea9-997d-42c3-9d5a-ff594c6623a1. Dropping event network-vif-unplugged {{(pid=118712) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jul 01 04:20:38.249012 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [req-b00413b3-feea-49f9-ab7e-294f552ceae6 req-9567c986-2d85-4a49-ace4-45e0c752ca44 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.043510 Jul 01 04:20:38.249680 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 539/1066] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Jul 1 04:20:38 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 45 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jul 01 04:20:38.249843 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-178ba969-b0cb-4b6c-a991-4ed35cd991ae tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] 10.222.0.20 "GET /compute/v2.1/servers/8dd47ea9-997d-42c3-9d5a-ff594c6623a1" status: 200 len: 1517 microversion: 2.1 time: 0.163661 Jul 01 04:20:38.250390 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 528/1067] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:20:38 2022] GET /compute/v2.1/servers/8dd47ea9-997d-42c3-9d5a-ff594c6623a1 => generated 1517 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:20:39.267064 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-94c8ddbc-d9dc-4fd7-88fa-82d6b1acafcb tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:20:39.267765 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-94c8ddbc-d9dc-4fd7-88fa-82d6b1acafcb tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] [instance: 8dd47ea9-997d-42c3-9d5a-ff594c6623a1] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:20:39.277124 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-94c8ddbc-d9dc-4fd7-88fa-82d6b1acafcb tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:20:39.277694 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-94c8ddbc-d9dc-4fd7-88fa-82d6b1acafcb tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:20:39.278389 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-94c8ddbc-d9dc-4fd7-88fa-82d6b1acafcb tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:20:39.278828 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-94c8ddbc-d9dc-4fd7-88fa-82d6b1acafcb tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:20:39.423078 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-94c8ddbc-d9dc-4fd7-88fa-82d6b1acafcb tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3e60783dd542dfbc3672c15c2807e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d3ef4d370f432bb537d528fdd0e718', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:20:39.430778 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-94c8ddbc-d9dc-4fd7-88fa-82d6b1acafcb tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] 10.222.0.20 "GET /compute/v2.1/servers/8dd47ea9-997d-42c3-9d5a-ff594c6623a1" status: 200 len: 1519 microversion: 2.1 time: 0.167460 Jul 01 04:20:39.431296 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 529/1068] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:20:39 2022] GET /compute/v2.1/servers/8dd47ea9-997d-42c3-9d5a-ff594c6623a1 => generated 1519 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:20:40.450261 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-16e3d708-a4f0-4499-a1b2-18fef0dd77ab tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:20:40.450824 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-16e3d708-a4f0-4499-a1b2-18fef0dd77ab tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] [instance: 8dd47ea9-997d-42c3-9d5a-ff594c6623a1] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:20:40.457430 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-16e3d708-a4f0-4499-a1b2-18fef0dd77ab tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:20:40.458550 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-16e3d708-a4f0-4499-a1b2-18fef0dd77ab tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:20:40.459370 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-16e3d708-a4f0-4499-a1b2-18fef0dd77ab tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:20:40.459822 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-16e3d708-a4f0-4499-a1b2-18fef0dd77ab tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:20:40.593301 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-16e3d708-a4f0-4499-a1b2-18fef0dd77ab tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3e60783dd542dfbc3672c15c2807e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d3ef4d370f432bb537d528fdd0e718', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:20:40.600911 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-16e3d708-a4f0-4499-a1b2-18fef0dd77ab tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] 10.222.0.20 "GET /compute/v2.1/servers/8dd47ea9-997d-42c3-9d5a-ff594c6623a1" status: 200 len: 1575 microversion: 2.1 time: 0.154670 Jul 01 04:20:40.601477 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 540/1069] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:20:40 2022] GET /compute/v2.1/servers/8dd47ea9-997d-42c3-9d5a-ff594c6623a1 => generated 1575 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 04:20:41.617927 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-4a032d50-9207-4bfc-9f11-5e4fbcf6de05 tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:20:41.618519 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-4a032d50-9207-4bfc-9f11-5e4fbcf6de05 tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] [instance: 8dd47ea9-997d-42c3-9d5a-ff594c6623a1] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:20:41.624987 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-4a032d50-9207-4bfc-9f11-5e4fbcf6de05 tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:20:41.625436 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-4a032d50-9207-4bfc-9f11-5e4fbcf6de05 tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:20:41.626196 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-4a032d50-9207-4bfc-9f11-5e4fbcf6de05 tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:20:41.626643 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-4a032d50-9207-4bfc-9f11-5e4fbcf6de05 tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:20:41.761026 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-4a032d50-9207-4bfc-9f11-5e4fbcf6de05 tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3e60783dd542dfbc3672c15c2807e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d3ef4d370f432bb537d528fdd0e718', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:20:41.768480 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-4a032d50-9207-4bfc-9f11-5e4fbcf6de05 tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] 10.222.0.20 "GET /compute/v2.1/servers/8dd47ea9-997d-42c3-9d5a-ff594c6623a1" status: 200 len: 1575 microversion: 2.1 time: 0.154425 Jul 01 04:20:41.769048 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 530/1070] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:20:41 2022] GET /compute/v2.1/servers/8dd47ea9-997d-42c3-9d5a-ff594c6623a1 => generated 1575 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:20:42.785833 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-25e53601-2d01-4057-a059-955e0791a55b tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:20:42.787296 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-25e53601-2d01-4057-a059-955e0791a55b tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] [instance: 8dd47ea9-997d-42c3-9d5a-ff594c6623a1] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:20:42.793793 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-25e53601-2d01-4057-a059-955e0791a55b tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:20:42.794248 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-25e53601-2d01-4057-a059-955e0791a55b tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:20:42.795017 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-25e53601-2d01-4057-a059-955e0791a55b tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:20:42.795486 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-25e53601-2d01-4057-a059-955e0791a55b tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:20:42.924979 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-25e53601-2d01-4057-a059-955e0791a55b tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3e60783dd542dfbc3672c15c2807e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d3ef4d370f432bb537d528fdd0e718', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:20:42.932938 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-25e53601-2d01-4057-a059-955e0791a55b tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] 10.222.0.20 "GET /compute/v2.1/servers/8dd47ea9-997d-42c3-9d5a-ff594c6623a1" status: 200 len: 1575 microversion: 2.1 time: 0.150970 Jul 01 04:20:42.933506 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 541/1071] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:20:42 2022] GET /compute/v2.1/servers/8dd47ea9-997d-42c3-9d5a-ff594c6623a1 => generated 1575 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:20:43.950757 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-6d814203-53ba-49a3-b6f9-d2160817ce29 tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:20:43.951424 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-6d814203-53ba-49a3-b6f9-d2160817ce29 tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] [instance: 8dd47ea9-997d-42c3-9d5a-ff594c6623a1] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:20:43.957859 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-6d814203-53ba-49a3-b6f9-d2160817ce29 tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:20:43.958314 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-6d814203-53ba-49a3-b6f9-d2160817ce29 tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:20:43.959128 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-6d814203-53ba-49a3-b6f9-d2160817ce29 tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:20:43.959540 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-6d814203-53ba-49a3-b6f9-d2160817ce29 tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:20:44.089604 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-6d814203-53ba-49a3-b6f9-d2160817ce29 tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3e60783dd542dfbc3672c15c2807e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d3ef4d370f432bb537d528fdd0e718', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:20:44.097197 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-6d814203-53ba-49a3-b6f9-d2160817ce29 tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] 10.222.0.20 "GET /compute/v2.1/servers/8dd47ea9-997d-42c3-9d5a-ff594c6623a1" status: 200 len: 1575 microversion: 2.1 time: 0.150367 Jul 01 04:20:44.097773 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 531/1072] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:20:43 2022] GET /compute/v2.1/servers/8dd47ea9-997d-42c3-9d5a-ff594c6623a1 => generated 1575 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:20:45.115147 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-8e307ab5-df5e-4f8c-be1e-a483dfc035fd tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:20:45.115788 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-8e307ab5-df5e-4f8c-be1e-a483dfc035fd tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] [instance: 8dd47ea9-997d-42c3-9d5a-ff594c6623a1] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:20:45.122646 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-8e307ab5-df5e-4f8c-be1e-a483dfc035fd tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:20:45.123099 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-8e307ab5-df5e-4f8c-be1e-a483dfc035fd tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:20:45.123901 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-8e307ab5-df5e-4f8c-be1e-a483dfc035fd tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:20:45.124349 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-8e307ab5-df5e-4f8c-be1e-a483dfc035fd tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:20:45.261700 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-8e307ab5-df5e-4f8c-be1e-a483dfc035fd tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3e60783dd542dfbc3672c15c2807e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d3ef4d370f432bb537d528fdd0e718', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:20:45.269341 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-8e307ab5-df5e-4f8c-be1e-a483dfc035fd tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] 10.222.0.20 "GET /compute/v2.1/servers/8dd47ea9-997d-42c3-9d5a-ff594c6623a1" status: 200 len: 1575 microversion: 2.1 time: 0.158255 Jul 01 04:20:45.269894 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 542/1073] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:20:45 2022] GET /compute/v2.1/servers/8dd47ea9-997d-42c3-9d5a-ff594c6623a1 => generated 1575 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:20:46.290110 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-258b97c4-f8b9-49f7-a74b-f7485f9bd3bc tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:20:46.290720 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-258b97c4-f8b9-49f7-a74b-f7485f9bd3bc tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] [instance: 8dd47ea9-997d-42c3-9d5a-ff594c6623a1] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:20:46.297295 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-258b97c4-f8b9-49f7-a74b-f7485f9bd3bc tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:20:46.297737 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-258b97c4-f8b9-49f7-a74b-f7485f9bd3bc tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:20:46.298501 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-258b97c4-f8b9-49f7-a74b-f7485f9bd3bc tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:20:46.298930 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-258b97c4-f8b9-49f7-a74b-f7485f9bd3bc tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:20:46.431243 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-258b97c4-f8b9-49f7-a74b-f7485f9bd3bc tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3e60783dd542dfbc3672c15c2807e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d3ef4d370f432bb537d528fdd0e718', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:20:46.438729 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-258b97c4-f8b9-49f7-a74b-f7485f9bd3bc tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] 10.222.0.20 "GET /compute/v2.1/servers/8dd47ea9-997d-42c3-9d5a-ff594c6623a1" status: 200 len: 1575 microversion: 2.1 time: 0.152761 Jul 01 04:20:46.439311 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 532/1074] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:20:46 2022] GET /compute/v2.1/servers/8dd47ea9-997d-42c3-9d5a-ff594c6623a1 => generated 1575 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:20:47.456586 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-3c695716-c4b9-435a-b540-ff999dd2f18c tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:20:47.457190 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-3c695716-c4b9-435a-b540-ff999dd2f18c tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] [instance: 8dd47ea9-997d-42c3-9d5a-ff594c6623a1] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:20:47.464286 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-3c695716-c4b9-435a-b540-ff999dd2f18c tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:20:47.464727 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-3c695716-c4b9-435a-b540-ff999dd2f18c tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:20:47.466565 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-3c695716-c4b9-435a-b540-ff999dd2f18c tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:20:47.466565 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-3c695716-c4b9-435a-b540-ff999dd2f18c tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:20:47.598883 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-3c695716-c4b9-435a-b540-ff999dd2f18c tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3e60783dd542dfbc3672c15c2807e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d3ef4d370f432bb537d528fdd0e718', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:20:47.606401 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-3c695716-c4b9-435a-b540-ff999dd2f18c tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] 10.222.0.20 "GET /compute/v2.1/servers/8dd47ea9-997d-42c3-9d5a-ff594c6623a1" status: 200 len: 1575 microversion: 2.1 time: 0.153731 Jul 01 04:20:47.606973 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 543/1075] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:20:47 2022] GET /compute/v2.1/servers/8dd47ea9-997d-42c3-9d5a-ff594c6623a1 => generated 1575 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 04:20:48.623633 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-52b322da-8e0d-4a09-a798-08fb959344a0 tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:20:48.624205 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-52b322da-8e0d-4a09-a798-08fb959344a0 tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] [instance: 8dd47ea9-997d-42c3-9d5a-ff594c6623a1] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:20:48.631195 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-52b322da-8e0d-4a09-a798-08fb959344a0 tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:20:48.631688 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-52b322da-8e0d-4a09-a798-08fb959344a0 tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:20:48.632463 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-52b322da-8e0d-4a09-a798-08fb959344a0 tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:20:48.632941 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-52b322da-8e0d-4a09-a798-08fb959344a0 tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:20:48.767789 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-52b322da-8e0d-4a09-a798-08fb959344a0 tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3e60783dd542dfbc3672c15c2807e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d3ef4d370f432bb537d528fdd0e718', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:20:48.776252 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-52b322da-8e0d-4a09-a798-08fb959344a0 tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] 10.222.0.20 "GET /compute/v2.1/servers/8dd47ea9-997d-42c3-9d5a-ff594c6623a1" status: 200 len: 1575 microversion: 2.1 time: 0.156716 Jul 01 04:20:48.776832 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 533/1076] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:20:48 2022] GET /compute/v2.1/servers/8dd47ea9-997d-42c3-9d5a-ff594c6623a1 => generated 1575 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:20:49.792804 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-448b3097-569b-4af6-877d-acef842535c8 tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:20:49.793410 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-448b3097-569b-4af6-877d-acef842535c8 tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] [instance: 8dd47ea9-997d-42c3-9d5a-ff594c6623a1] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:20:49.799826 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-448b3097-569b-4af6-877d-acef842535c8 tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:20:49.800273 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-448b3097-569b-4af6-877d-acef842535c8 tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:20:49.801079 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-448b3097-569b-4af6-877d-acef842535c8 tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:20:49.801516 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-448b3097-569b-4af6-877d-acef842535c8 tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:20:49.936332 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-448b3097-569b-4af6-877d-acef842535c8 tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3e60783dd542dfbc3672c15c2807e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d3ef4d370f432bb537d528fdd0e718', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:20:49.944624 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-448b3097-569b-4af6-877d-acef842535c8 tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] 10.222.0.20 "GET /compute/v2.1/servers/8dd47ea9-997d-42c3-9d5a-ff594c6623a1" status: 200 len: 1575 microversion: 2.1 time: 0.155660 Jul 01 04:20:49.945434 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 544/1077] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:20:49 2022] GET /compute/v2.1/servers/8dd47ea9-997d-42c3-9d5a-ff594c6623a1 => generated 1575 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:20:50.286463 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [req-999a79d7-618b-47fd-86b2-db37e473afbc req-2a2c4abb-8aa5-4574-a7aa-d701a72ec7b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8dd47ea9-997d-42c3-9d5a-ff594c6623a1", "name": "network-vif-plugged", "status": "completed", "tag": "4551fc91-3567-411a-8170-956e8d791b33"}]} {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 04:20:50.295438 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [req-999a79d7-618b-47fd-86b2-db37e473afbc req-2a2c4abb-8aa5-4574-a7aa-d701a72ec7b8 service nova] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:20:50.295906 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [req-999a79d7-618b-47fd-86b2-db37e473afbc req-2a2c4abb-8aa5-4574-a7aa-d701a72ec7b8 service nova] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:20:50.307568 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.compute.server_external_events [req-999a79d7-618b-47fd-86b2-db37e473afbc req-2a2c4abb-8aa5-4574-a7aa-d701a72ec7b8 service nova] Creating event network-vif-plugged:4551fc91-3567-411a-8170-956e8d791b33 for instance 8dd47ea9-997d-42c3-9d5a-ff594c6623a1 on hv-cinder-84684 Jul 01 04:20:50.312688 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [req-999a79d7-618b-47fd-86b2-db37e473afbc req-2a2c4abb-8aa5-4574-a7aa-d701a72ec7b8 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029980 Jul 01 04:20:50.313277 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 534/1078] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Jul 1 04:20:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 04:20:50.962550 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-9809a5dd-82ec-4ce2-9792-6a03f5ad56e3 tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:20:50.963085 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-9809a5dd-82ec-4ce2-9792-6a03f5ad56e3 tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] [instance: 8dd47ea9-997d-42c3-9d5a-ff594c6623a1] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:20:50.969511 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-9809a5dd-82ec-4ce2-9792-6a03f5ad56e3 tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:20:50.969959 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-9809a5dd-82ec-4ce2-9792-6a03f5ad56e3 tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:20:50.970713 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-9809a5dd-82ec-4ce2-9792-6a03f5ad56e3 tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:20:50.971152 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-9809a5dd-82ec-4ce2-9792-6a03f5ad56e3 tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:20:50.975064 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG dbcounter [-] [118712] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=118712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:20:51.103524 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-9809a5dd-82ec-4ce2-9792-6a03f5ad56e3 tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3e60783dd542dfbc3672c15c2807e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d3ef4d370f432bb537d528fdd0e718', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:20:51.110938 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-9809a5dd-82ec-4ce2-9792-6a03f5ad56e3 tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] 10.222.0.20 "GET /compute/v2.1/servers/8dd47ea9-997d-42c3-9d5a-ff594c6623a1" status: 200 len: 1575 microversion: 2.1 time: 0.152991 Jul 01 04:20:51.111526 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 545/1079] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:20:50 2022] GET /compute/v2.1/servers/8dd47ea9-997d-42c3-9d5a-ff594c6623a1 => generated 1575 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:20:52.128972 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-f159ddd9-d4f6-463d-874e-43346c8851f1 tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:20:52.129678 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-f159ddd9-d4f6-463d-874e-43346c8851f1 tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] [instance: 8dd47ea9-997d-42c3-9d5a-ff594c6623a1] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:20:52.135899 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-f159ddd9-d4f6-463d-874e-43346c8851f1 tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:20:52.136353 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-f159ddd9-d4f6-463d-874e-43346c8851f1 tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:20:52.137115 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-f159ddd9-d4f6-463d-874e-43346c8851f1 tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:20:52.137556 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-f159ddd9-d4f6-463d-874e-43346c8851f1 tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:20:52.272046 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-f159ddd9-d4f6-463d-874e-43346c8851f1 tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3e60783dd542dfbc3672c15c2807e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d3ef4d370f432bb537d528fdd0e718', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:20:52.279700 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-f159ddd9-d4f6-463d-874e-43346c8851f1 tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] 10.222.0.20 "GET /compute/v2.1/servers/8dd47ea9-997d-42c3-9d5a-ff594c6623a1" status: 200 len: 1562 microversion: 2.1 time: 0.155432 Jul 01 04:20:52.280267 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 535/1080] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:20:52 2022] GET /compute/v2.1/servers/8dd47ea9-997d-42c3-9d5a-ff594c6623a1 => generated 1562 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:21:24.513598 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 01 04:21:24.514279 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: Fri Jul 1 04:21:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 01 04:22:03.420291 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG dbcounter [-] [118711] Writing DB stats nova_api:SELECT=30 {{(pid=118711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:22:03.421045 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG dbcounter [-] [118711] Writing DB stats nova_cell1:SELECT=86 {{(pid=118711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:22:03.421181 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-b4a5e8cd-104d-4d14-8f60-0aa535eb4ea7 tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:22:03.421647 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-b4a5e8cd-104d-4d14-8f60-0aa535eb4ea7 tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] [instance: 8dd47ea9-997d-42c3-9d5a-ff594c6623a1] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:22:03.424134 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG dbcounter [-] [118712] Writing DB stats nova_api:SELECT=32 {{(pid=118712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:22:03.425523 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG dbcounter [-] [118712] Writing DB stats nova_cell1:SELECT=4 {{(pid=118712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:22:03.431995 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-b4a5e8cd-104d-4d14-8f60-0aa535eb4ea7 tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:22:03.431995 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-b4a5e8cd-104d-4d14-8f60-0aa535eb4ea7 tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:22:03.433313 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-b4a5e8cd-104d-4d14-8f60-0aa535eb4ea7 tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:22:03.433972 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-b4a5e8cd-104d-4d14-8f60-0aa535eb4ea7 tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:22:03.462232 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-b4a5e8cd-104d-4d14-8f60-0aa535eb4ea7 tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] [instance: 8dd47ea9-997d-42c3-9d5a-ff594c6623a1] Going to try to terminate instance {{(pid=118712) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 01 04:22:03.490435 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [req-83f7cf36-4128-4aee-b913-b44e2060baaf req-af2bd0b6-d12f-462e-96fa-6c07adbc5e84 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8dd47ea9-997d-42c3-9d5a-ff594c6623a1", "tag": "4551fc91-3567-411a-8170-956e8d791b33"}]} {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 04:22:03.499119 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [req-83f7cf36-4128-4aee-b913-b44e2060baaf req-af2bd0b6-d12f-462e-96fa-6c07adbc5e84 service nova] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:22:03.499857 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [req-83f7cf36-4128-4aee-b913-b44e2060baaf req-af2bd0b6-d12f-462e-96fa-6c07adbc5e84 service nova] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:22:03.511995 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.compute.server_external_events [req-83f7cf36-4128-4aee-b913-b44e2060baaf req-af2bd0b6-d12f-462e-96fa-6c07adbc5e84 service nova] Creating event network-changed:4551fc91-3567-411a-8170-956e8d791b33 for instance 8dd47ea9-997d-42c3-9d5a-ff594c6623a1 on hv-cinder-84684 Jul 01 04:22:03.517105 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [req-83f7cf36-4128-4aee-b913-b44e2060baaf req-af2bd0b6-d12f-462e-96fa-6c07adbc5e84 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098500 Jul 01 04:22:03.517687 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 536/1081] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Jul 1 04:22:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 04:22:03.758246 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-b4a5e8cd-104d-4d14-8f60-0aa535eb4ea7 tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] 10.222.0.20 "DELETE /compute/v2.1/servers/8dd47ea9-997d-42c3-9d5a-ff594c6623a1" status: 204 len: 0 microversion: 2.1 time: 0.341827 Jul 01 04:22:03.759030 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 546/1082] 10.222.0.20 () {58 vars in 1238 bytes} [Fri Jul 1 04:22:03 2022] DELETE /compute/v2.1/servers/8dd47ea9-997d-42c3-9d5a-ff594c6623a1 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 01 04:22:03.773663 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-3387f505-0fc2-4fcb-af99-b172cfa190ad tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:22:03.774362 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-3387f505-0fc2-4fcb-af99-b172cfa190ad tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] [instance: 8dd47ea9-997d-42c3-9d5a-ff594c6623a1] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:22:03.780634 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-3387f505-0fc2-4fcb-af99-b172cfa190ad tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:22:03.781084 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-3387f505-0fc2-4fcb-af99-b172cfa190ad tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:22:03.781875 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-3387f505-0fc2-4fcb-af99-b172cfa190ad tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:22:03.782301 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-3387f505-0fc2-4fcb-af99-b172cfa190ad tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:22:03.918389 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-3387f505-0fc2-4fcb-af99-b172cfa190ad tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3e60783dd542dfbc3672c15c2807e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d3ef4d370f432bb537d528fdd0e718', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:22:03.925971 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-3387f505-0fc2-4fcb-af99-b172cfa190ad tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] 10.222.0.20 "GET /compute/v2.1/servers/8dd47ea9-997d-42c3-9d5a-ff594c6623a1" status: 200 len: 1568 microversion: 2.1 time: 0.157158 Jul 01 04:22:03.926528 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 537/1083] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:22:03 2022] GET /compute/v2.1/servers/8dd47ea9-997d-42c3-9d5a-ff594c6623a1 => generated 1568 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 04:22:04.945023 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-e69f9070-fc13-45ba-8bd3-c074031b9983 tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:22:04.946041 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-e69f9070-fc13-45ba-8bd3-c074031b9983 tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] [instance: 8dd47ea9-997d-42c3-9d5a-ff594c6623a1] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:22:04.952535 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-e69f9070-fc13-45ba-8bd3-c074031b9983 tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:22:04.952992 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-e69f9070-fc13-45ba-8bd3-c074031b9983 tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:22:04.953774 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-e69f9070-fc13-45ba-8bd3-c074031b9983 tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:22:04.954225 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-e69f9070-fc13-45ba-8bd3-c074031b9983 tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:22:05.087092 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-e69f9070-fc13-45ba-8bd3-c074031b9983 tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3e60783dd542dfbc3672c15c2807e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d3ef4d370f432bb537d528fdd0e718', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:22:05.094601 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-e69f9070-fc13-45ba-8bd3-c074031b9983 tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] 10.222.0.20 "GET /compute/v2.1/servers/8dd47ea9-997d-42c3-9d5a-ff594c6623a1" status: 200 len: 1568 microversion: 2.1 time: 0.153851 Jul 01 04:22:05.095165 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 547/1084] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:22:04 2022] GET /compute/v2.1/servers/8dd47ea9-997d-42c3-9d5a-ff594c6623a1 => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:22:06.011407 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [req-0a61492d-ddfa-44cf-8018-1f920dde2bce req-f7819fee-5b9d-4ce0-9e37-231e473c481a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8dd47ea9-997d-42c3-9d5a-ff594c6623a1", "name": "network-vif-deleted", "tag": "4551fc91-3567-411a-8170-956e8d791b33"}]} {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 04:22:06.020004 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [req-0a61492d-ddfa-44cf-8018-1f920dde2bce req-f7819fee-5b9d-4ce0-9e37-231e473c481a service nova] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:22:06.023319 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [req-0a61492d-ddfa-44cf-8018-1f920dde2bce req-f7819fee-5b9d-4ce0-9e37-231e473c481a service nova] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:22:06.031009 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.compute.server_external_events [req-0a61492d-ddfa-44cf-8018-1f920dde2bce req-f7819fee-5b9d-4ce0-9e37-231e473c481a service nova] Creating event network-vif-deleted:4551fc91-3567-411a-8170-956e8d791b33 for instance 8dd47ea9-997d-42c3-9d5a-ff594c6623a1 on hv-cinder-84684 Jul 01 04:22:06.035698 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [req-0a61492d-ddfa-44cf-8018-1f920dde2bce req-f7819fee-5b9d-4ce0-9e37-231e473c481a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028633 Jul 01 04:22:06.036264 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 538/1085] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Jul 1 04:22:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 04:22:06.112207 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-fce1af65-25bb-4c26-92c8-cce2fc3a03e6 tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:22:06.112909 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-fce1af65-25bb-4c26-92c8-cce2fc3a03e6 tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] [instance: 8dd47ea9-997d-42c3-9d5a-ff594c6623a1] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:22:06.119955 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-fce1af65-25bb-4c26-92c8-cce2fc3a03e6 tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:22:06.120405 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-fce1af65-25bb-4c26-92c8-cce2fc3a03e6 tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:22:06.121168 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-fce1af65-25bb-4c26-92c8-cce2fc3a03e6 tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:22:06.121609 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-fce1af65-25bb-4c26-92c8-cce2fc3a03e6 tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:22:06.186058 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.policy [None req-fce1af65-25bb-4c26-92c8-cce2fc3a03e6 tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3e60783dd542dfbc3672c15c2807e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d3ef4d370f432bb537d528fdd0e718', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:22:06.195450 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-fce1af65-25bb-4c26-92c8-cce2fc3a03e6 tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] 10.222.0.20 "GET /compute/v2.1/servers/8dd47ea9-997d-42c3-9d5a-ff594c6623a1" status: 200 len: 1382 microversion: 2.1 time: 0.086089 Jul 01 04:22:06.195450 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 548/1086] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:22:06 2022] GET /compute/v2.1/servers/8dd47ea9-997d-42c3-9d5a-ff594c6623a1 => generated 1382 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 04:22:07.212690 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-187087c4-e9b4-4f05-b6d4-47f5f3444701 tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] Calling method '>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:22:07.213529 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.compute.api [None req-187087c4-e9b4-4f05-b6d4-47f5f3444701 tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] [instance: 8dd47ea9-997d-42c3-9d5a-ff594c6623a1] Fetching instance by UUID {{(pid=118711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:22:07.219691 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-187087c4-e9b4-4f05-b6d4-47f5f3444701 tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:22:07.220145 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-187087c4-e9b4-4f05-b6d4-47f5f3444701 tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:22:07.220912 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-187087c4-e9b4-4f05-b6d4-47f5f3444701 tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:22:07.221351 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-187087c4-e9b4-4f05-b6d4-47f5f3444701 tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:22:07.250907 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-187087c4-e9b4-4f05-b6d4-47f5f3444701 tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:22:07.251406 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG oslo_concurrency.lockutils [None req-187087c4-e9b4-4f05-b6d4-47f5f3444701 tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:22:07.251856 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.objects.instance [None req-187087c4-e9b4-4f05-b6d4-47f5f3444701 tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] Lazy-loading 'fault' on Instance uuid 8dd47ea9-997d-42c3-9d5a-ff594c6623a1 {{(pid=118711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 04:22:07.294841 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.policy [None req-187087c4-e9b4-4f05-b6d4-47f5f3444701 tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3e60783dd542dfbc3672c15c2807e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d3ef4d370f432bb537d528fdd0e718', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 04:22:07.302697 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-187087c4-e9b4-4f05-b6d4-47f5f3444701 tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] 10.222.0.20 "GET /compute/v2.1/servers/8dd47ea9-997d-42c3-9d5a-ff594c6623a1" status: 200 len: 1225 microversion: 2.1 time: 0.095353 Jul 01 04:22:07.303617 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 539/1087] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:22:07 2022] GET /compute/v2.1/servers/8dd47ea9-997d-42c3-9d5a-ff594c6623a1 => generated 1225 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 04:22:08.324122 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-83184dce-199f-4401-9512-12eb0b39684f tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] Calling method '>' {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:22:08.324755 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.compute.api [None req-83184dce-199f-4401-9512-12eb0b39684f tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] [instance: 8dd47ea9-997d-42c3-9d5a-ff594c6623a1] Fetching instance by UUID {{(pid=118712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 04:22:08.331113 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-83184dce-199f-4401-9512-12eb0b39684f tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:22:08.331615 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-83184dce-199f-4401-9512-12eb0b39684f tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:22:08.332368 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-83184dce-199f-4401-9512-12eb0b39684f tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 04:22:08.332809 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG oslo_concurrency.lockutils [None req-83184dce-199f-4401-9512-12eb0b39684f tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] Lock "645b6dde-2c23-4766-a50b-4919c2bf5c2f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 04:22:08.347539 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.wsgi [None req-83184dce-199f-4401-9512-12eb0b39684f tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] HTTP exception thrown: Instance 8dd47ea9-997d-42c3-9d5a-ff594c6623a1 could not be found. Jul 01 04:22:08.349837 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-83184dce-199f-4401-9512-12eb0b39684f tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] Request method failure captured: Jul 01 04:22:08.349837 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: request: GET /compute/v2.1/servers/8dd47ea9-997d-42c3-9d5a-ff594c6623a1 HTTP/1.1 Jul 01 04:22:08.349837 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: Accept: application/json Jul 01 04:22:08.349837 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: Accept-Encoding: identity Jul 01 04:22:08.349837 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: Connection: close Jul 01 04:22:08.349837 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: Content-Length: 0 Jul 01 04:22:08.349837 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: Content-Type: application/json Jul 01 04:22:08.349837 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: Host: 10.222.0.20 Jul 01 04:22:08.349837 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: Openstack-System-Scope: None Jul 01 04:22:08.349837 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: User-Agent: python-urllib3/1.26.9 Jul 01 04:22:08.349837 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Auth-Token: gAAAAABivnViBzo-Ag36-us6XajDTsk4EohJmFTeCWOG170w_59D12sEpv4IQx00-KAKxj8fiCgYX8SXFjHm0jlgOpKyjCYB2vxAOSz2SJGpa8LGsISdb5ywVT_Zuz4_j7ki3nyEH72K1vQU6XU1OtrNvAO0XIJ_jLj7x0wRYIuvKwifv-zDmM4 Jul 01 04:22:08.349837 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Domain-Id: None Jul 01 04:22:08.349837 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Domain-Name: None Jul 01 04:22:08.349837 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Identity-Status: Confirmed Jul 01 04:22:08.349837 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Is-Admin-Project: True Jul 01 04:22:08.349837 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Project-Domain-Id: default Jul 01 04:22:08.349837 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Project-Domain-Name: Default Jul 01 04:22:08.349837 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Project-Id: c3d3ef4d370f432bb537d528fdd0e718 Jul 01 04:22:08.349837 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Project-Name: tempest-TestShelveInstance-1009103495 Jul 01 04:22:08.349837 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Role: reader,member Jul 01 04:22:08.349837 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Roles: reader,member Jul 01 04:22:08.351706 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/c3d3ef4d370f432bb537d528fdd0e718"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_c3d3ef4d370f432bb537d528fdd0e718", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c3d3ef4d370f432bb537d528fdd0e718"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c3d3ef4d370f432bb537d528fdd0e718"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}] Jul 01 04:22:08.351706 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Tenant: tempest-TestShelveInstance-1009103495 Jul 01 04:22:08.351706 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Tenant-Id: c3d3ef4d370f432bb537d528fdd0e718 Jul 01 04:22:08.351706 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-Tenant-Name: tempest-TestShelveInstance-1009103495 Jul 01 04:22:08.351706 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-User: tempest-TestShelveInstance-1009103495-project Jul 01 04:22:08.351706 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-User-Domain-Id: default Jul 01 04:22:08.351706 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-User-Domain-Name: Default Jul 01 04:22:08.351706 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-User-Id: 7e3e60783dd542dfbc3672c15c2807e4 Jul 01 04:22:08.351706 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: X-User-Name: tempest-TestShelveInstance-1009103495-project Jul 01 04:22:08.351706 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: method: > Jul 01 04:22:08.351706 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: exception: Instance 8dd47ea9-997d-42c3-9d5a-ff594c6623a1 could not be found. Jul 01 04:22:08.351706 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: action_args: {'id': '8dd47ea9-997d-42c3-9d5a-ff594c6623a1'} Jul 01 04:22:08.352822 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: {{(pid=118712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 04:22:08.352822 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 04:22:08.352822 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 04:22:08.352822 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 04:22:08.352822 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 04:22:08.352822 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 04:22:08.352822 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 04:22:08.352822 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 04:22:08.352822 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 04:22:08.352822 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 04:22:08.352822 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8dd47ea9-997d-42c3-9d5a-ff594c6623a1 could not be found. Jul 01 04:22:08.352822 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi Jul 01 04:22:08.352822 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 04:22:08.352822 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi Jul 01 04:22:08.352822 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 04:22:08.352822 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 04:22:08.352822 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 04:22:08.352822 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 04:22:08.352822 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 04:22:08.352822 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 04:22:08.354718 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 04:22:08.354718 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 04:22:08.354718 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 04:22:08.354718 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 04:22:08.354718 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 04:22:08.354718 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 04:22:08.354718 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 04:22:08.354718 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8dd47ea9-997d-42c3-9d5a-ff594c6623a1 could not be found. Jul 01 04:22:08.354718 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi Jul 01 04:22:08.354718 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 04:22:08.354718 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi Jul 01 04:22:08.354718 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 04:22:08.354718 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 04:22:08.354718 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 04:22:08.354718 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 04:22:08.354718 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 04:22:08.354718 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8dd47ea9-997d-42c3-9d5a-ff594c6623a1 could not be found. Jul 01 04:22:08.354718 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: ERROR nova.api.openstack.wsgi Jul 01 04:22:08.356289 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: DEBUG nova.api.openstack.wsgi [None req-83184dce-199f-4401-9512-12eb0b39684f tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] Returning 404 to user: Instance 8dd47ea9-997d-42c3-9d5a-ff594c6623a1 could not be found. {{(pid=118712) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 04:22:08.356289 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO nova.api.openstack.requestlog [None req-83184dce-199f-4401-9512-12eb0b39684f tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] 10.222.0.20 "GET /compute/v2.1/servers/8dd47ea9-997d-42c3-9d5a-ff594c6623a1" status: 404 len: 111 microversion: 2.1 time: 0.031201 Jul 01 04:22:08.356289 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: [pid: 118712|app: 0|req: 549/1088] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 1 04:22:08 2022] GET /compute/v2.1/servers/8dd47ea9-997d-42c3-9d5a-ff594c6623a1 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 04:22:08.574911 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: DEBUG nova.api.openstack.wsgi [None req-c3a66a99-2f2b-4956-a05b-c5c86f4d2c7d tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] Calling method '.version_select at 0x7f99a08460d0>' {{(pid=118711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 04:22:08.668200 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO nova.api.openstack.requestlog [None req-c3a66a99-2f2b-4956-a05b-c5c86f4d2c7d tempest-TestShelveInstance-1009103495 tempest-TestShelveInstance-1009103495-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-2007925812" status: 202 len: 0 microversion: 2.1 time: 0.097262 Jul 01 04:22:08.668715 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: [pid: 118711|app: 0|req: 540/1089] 10.222.0.20 () {58 vars in 1253 bytes} [Fri Jul 1 04:22:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-2007925812 => generated 0 bytes in 99 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 04:22:59.897990 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 01 04:22:59.898590 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: Fri Jul 1 04:22:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 01 04:23:07.301345 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 01 04:23:07.302001 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: Fri Jul 1 04:23:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 01 04:24:44.522332 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 01 04:24:44.522892 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: Fri Jul 1 04:24:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 01 04:24:46.140972 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 01 04:24:46.141626 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: Fri Jul 1 04:24:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 01 04:25:07.395957 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 01 04:25:07.396730 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: Fri Jul 1 04:25:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 01 04:25:22.976540 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 01 04:25:22.977001 dv-cinder-846842-8-iscsi devstack@n-api.service[118711]: Fri Jul 1 04:25:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 01 04:26:19.906392 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 01 04:26:19.906978 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: Fri Jul 1 04:26:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 01 04:26:27.309561 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 01 04:26:27.310258 dv-cinder-846842-8-iscsi devstack@n-api.service[118712]: Fri Jul 1 04:26:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!